Whether it's AI or us, it's OK to be ignorant

Our search for answers begins by recognising that we don’t have them.

Simon Walters

Simon Walters is Curate at Holy Trinity Huddersfield.

A street sticker displays multiple lines reading 'and then?'

Stephen Harlan on Unsplash.

When was the last time you admitted you didn’t know something? I don’t say it as much as I ought to. I’ve certainly felt the consequences of admitting ignorance – of being ridiculed for being entirely unaware of a pop culture reference, of being found out that I wasn’t paying as close attention to what my partner was saying as she expected. In a hyper-connected age when the wealth of human knowledge is at our fingertips, ignorance can hardly be viewed as a virtue.

A recent study on the development of artificial intelligence holds out more hope for the value of admitting our ignorance than we might have previously imagined. Despite wide-spread hype and fearmongering about the perils of AI, our current models are in many ways developed in similar ways to how an animal is trained. An AI system such as ChatGPT might have access to unimaginable amounts of information, but it requires training by humans on what information is valuable or not, whether it has appropriately understood the request it has received, and whether its answer is correct. The idea is that human feedback helps the AI to hone its model through positive feedback for correct answers, and negative feedback for incorrect answers, so that it keeps whatever method led to positive feedback and changes whatever method led to negative feedback. It really isn’t that far away from how animals are trained.

However, a problem has emerged. AI systems have become adept at giving coherent and convincing sounding answers that are entirely incorrect. How has this happened?

This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality.

In digging into the training method for AI, the researchers found that the humans training the AI flagged answers of “I don’t know” as unsatisfactory. On one level this makes sense. The whole purpose of these systems is to provide answers, after all. But rather than causing the AI to return and rethink its data, it instead developed increasingly convincing answers that were not true whatsoever, to the point where the human supervisors didn’t flag sufficiently convincing answers as wrong because they themselves didn’t realise that they were wrong. The result is that “the more difficult the question and the more advanced model you use, the more likely you are to get well-packaged, plausible nonsense as your answer.”

Uncovering some of what is going on in AI systems dispels both the fervent hype that artificial intelligence might be our saviour, and the deep fear that it might be our societal downfall. This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality. Whether it is used for good or ill depends on the approach of the humans that use it.

But this study also uncovers our strained relationship with ignorance. Problems arise in the answers given by systems like ChatGPT because a convincing answer is valued more than admitting ignorance, even if the convincing answer is not at all correct. Because the AI has been trained to avoid admitting it doesn’t know something, all of its answers are less reliable, even the ones that are actually correct.

This is not a problem limited to artificial intelligence. I had a friend who seemed incapable of admitting that he didn’t know something, and whenever he was corrected by someone else, he would make it sound like his first answer was actually the correct one, rather than whatever he had said. I don’t know how aware he was that he did this, but the result was that I didn’t particularly trust whatever he said to be correct. Paradoxically, had he admitted his ignorance more readily, I would have believed him to be less ignorant.

It is strange that admitting ignorance is so avoided. After all, it is in many ways our default state. No one faults a baby or a child for not knowing things. If anything, we expect ignorance to be a fuel for curiosity. Our search for answers begins in the recognition that we don’t have them. And in an age where approximately 500 hours of video is uploaded to YouTube every minute, the sum of what we don’t know must by necessity be vastly greater than all that we do know. What any one of us can know is only a small fraction of all there is to know.

Crucially, admitting we do not know everything is not the same as saying that we do not know anything.

One of the gifts of Christian theology is an ability to recognize what it is that makes us human. One of these things is the fact that any created thing is, by definition, limited. God alone is the only one who can be described by the ‘omnis’. He is omnipotent, omnipresent, and omniscient. There is no limit to his power, and presence, and knowledge. The distinction between creator and creation means that created things have limits to their power, presence, and knowledge. We cannot do whatever we want. We cannot be everywhere at the same time. And we cannot know everything there is to be known.

Projecting infinite knowledge is essentially claiming to be God. Admitting our ignorance is therefore merely recognizing our nature as created beings, acknowledging to one another that we are not God and therefore cannot know everything. But, crucially, admitting we do not know everything is not the same as saying that we do not know anything. Our God-given nature is one of discovery and learning. I sometimes like to imagine God’s delight in our discovery of some previously unknown facet of his creation, as he gets to share with us in all that he has made. Perhaps what really matters is what we do with our ignorance. Will we simply remain satisfied not to know, or will it turn us outwards to delight in the new things that lie behind every corner?

For the developers of ChatGPT and the like, there is also a reminder here that we ought not to expect AI to take on the attributes of God. AI used well in the hands of humans may yet do extraordinary things for us, but it will not truly be able to do anything, be everywhere, or know everything. Perhaps if it was trained to say ‘I don’t know’ a little more, we might all learn a little more about the nature of the world God has made.

Article

Comment

Trauma

9 May 2024

5 min read

Bitterness and weaponised words can’t soften scars

Finding peace for Daniel Anjorin, Salman Rushdie and Bishop Mar Mari.

Krish Kandiah

Krish is a social entrepreneur partnering across civil society, faith communities, government and philanthropy. He founded The Sanctuary Foundation.

A man sits being interviewed and holds a hand to the side of his face, one lens of his glasses is tinted black.

Salman Rushdie discusses his attack.

BBC.

Knife crime around the world is unacceptably high, and with around 50,000 offences expected this year in the UK, it is sadly no surprise when we hear tragic news stories involving knives and sharp instruments. Recently, it was the terrible circumstances of the death of Daniel Anjorin that made the headlines. The gentle, much-loved, 14-year-old boy was on his way to school in East London when he, along with several others, was randomly attacked by a man with a sword. He died from his wounds shortly after being taken to hospital.

I happened to be in the middle of listening to Knife, a memoir by Salman Rushdie, when the news broke of that tragedy. It is another heart-rending story. Rushdie describes how, in 2022, during a speech he was giving about the need to protect writers, a man ran onto the stage and frantically stabbed him 15 times. Rushdie was airlifted to a hospital and survived the attack but lost an eye. Then began his difficult physical and emotional journey towards recovery, documented in the book he never wanted to write.

It was not the first time Rushdie had been the victim of aggression. In 1988, following the publication of his novel The Satanic Verses, the Iranian government called for Rushdie’s death by issuing a fatwa against him. His book was perceived to be blasphemous to the Islamic faith, and despite ten years of round-the-clock police protection in London, he faced several serious assassination attempts.

The fatwa was lifted in 1998, but twenty-four years later, Rushdie was clearly still not safe. He recounts the moment when he saw the man running at him in the darkness as he gave his lecture.

“My first thought when I saw this murderous shape rushing towards me was: So it is you. Here you are…. It struck me as anachronistic. This was my second thought: Why now? Really? It’s been so long. Why now after all these years? Surely the world had moved on, and that subject was closed. Yet here, approaching fast, was a sort of time traveller, a murderous ghost from the past.”

I can’t imagine how I would cope in his shoes. I have not had to experience the daily fear of assassination for decades as Rushdie has. In all my years of delivering speeches and sermons on stages around the world, I have never had cause to even contemplate the possibility of an attempt on my life. Nevertheless, I was surprised to hear in Rushdie’s voice, the words he chose to say to his attacker:

“If I think of you at all in the future it will be with a dismissive shrug. I don't forgive you. I don't not forgive you. You are simply irrelevant to me, and from now on, for the rest of your days, you will be irrelevant to everyone else. I'm glad I have my life and not yours and my life will go on.”

Rushdie admits that his words are his weapons – and he certainly uses them to good effect. They are sharp. They are designed to eviscerate. They are calculated to cause pain. They express derision towards his attacker. Part of me cheers him on: a defenceless man in his seventies who walked into a lecture hall expecting to give a speech to rapturous applause but left barely alive as the victim of a brutal frenzied attack. Like the plot of every action movie I have ever seen, the story seems to have a happy ending – the hero is saved, the bad guy is locked up and justice is seen to be done.

But there is another part of me that knows these Hollywood endings can’t be trusted. Those 27 seconds of violence have clearly left Rushdie reduced to spitting insults at a young man in prison. He claims his life now is “filled with love”, but sadly there is little evidence of it in the way he addresses the radicalised 24-year-old. Bitterness and weaponised words, however eloquent, can’t soften the scars, nor do they make the world a safer place.

Indeed, I have found it difficult to forgive the comparatively trivial experience of being metaphorically stabbed in the back.

I can’t help but compare Rushdie’s reaction with that of Bishop Mar Mari Emanuel. The day before Knife was published, the Iraqi-born bishop was preaching at his church in Sydney, Australia, when he too was attacked by a young man with a knife, and, like Rushdie, ended up losing an eye. The attack was an overt terrorist act against Bishop Mar Mari, a controversial figure who has spoken dismissively about the Islamic, Jewish and LGBTQ+ communities.

Despite the striking similarities between the two men’s terrible ordeals, the contrast in their response couldn’t be starker. Speaking just two weeks later at a Palm Sunday service, Bishop Emanuel affirmed that he had forgiven his teenage assailant:

‘I say to you, my dear, you are my son, and you will always be my son. I will always pray for you. I’ll always wish you nothing but the best. I pray that my Lord and Saviour Jesus Christ of Nazareth, to enlighten your heart and enlighten your soul your entire being to realise, my dear, there is only one God who art in heaven…. the Lord knows it is coming from the bottom of my heart. I’ll always pray for you and for whoever was in this act. In the name of my Jesus, I forgive you. I love you, and I will always pray for you.”

Woven into the fabric of every form of Christianity is a commitment to love and forgiveness, clearly exemplified for us here by Bishop Mar Mari. His words resonated around the world this week as he returned to the pulpit where he was stabbed, bandage over one of his eyes, to speak out with kindness and compassion.

I am deeply challenged by the bishop’s response. I have never experienced the physical pain and emotional trauma of a knife attack. Indeed, I have found it difficult to forgive the comparatively trivial experience of being metaphorically stabbed in the back. I know how hard it is, to be gracious to those who deliberately cause pain to me or to my family members through their actions. Like Rushdie, I sometimes I would like nothing more than to see them locked up, living a loveless, meaningless, irrelevant life. But this is not the Christian way. I follow Jesus who forgave the soldiers driving nails through his hands and feet, so I must strive to be compassionate to those who do us much lesser harm, as well as seek, in his name, to tackle the underlying causes for the greater dis-ease in society.

The issues that lead to knife crime are many and complex. They include poverty, fear of victimisation, gang culture, radicalisation, distrust of authorities, lack of education, experience of violence in childhood, and much more. Whatever we can do to tackle these problems, we do for the sake of love and peace in our world. Perhaps as we seek to overcome these things together, we can work towards a day when what happened to Daniel Anjorin on 30th April can never happen again.