Whether it's AI or us, it's OK to be ignorant

Our search for answers begins by recognising that we don’t have them.

Simon Walters

Simon Walters is Curate at Holy Trinity Huddersfield.

A street sticker displays multiple lines reading 'and then?'

Stephen Harlan on Unsplash.

When was the last time you admitted you didn’t know something? I don’t say it as much as I ought to. I’ve certainly felt the consequences of admitting ignorance – of being ridiculed for being entirely unaware of a pop culture reference, of being found out that I wasn’t paying as close attention to what my partner was saying as she expected. In a hyper-connected age when the wealth of human knowledge is at our fingertips, ignorance can hardly be viewed as a virtue.

A recent study on the development of artificial intelligence holds out more hope for the value of admitting our ignorance than we might have previously imagined. Despite wide-spread hype and fearmongering about the perils of AI, our current models are in many ways developed in similar ways to how an animal is trained. An AI system such as ChatGPT might have access to unimaginable amounts of information, but it requires training by humans on what information is valuable or not, whether it has appropriately understood the request it has received, and whether its answer is correct. The idea is that human feedback helps the AI to hone its model through positive feedback for correct answers, and negative feedback for incorrect answers, so that it keeps whatever method led to positive feedback and changes whatever method led to negative feedback. It really isn’t that far away from how animals are trained.

However, a problem has emerged. AI systems have become adept at giving coherent and convincing sounding answers that are entirely incorrect. How has this happened?

This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality.

In digging into the training method for AI, the researchers found that the humans training the AI flagged answers of “I don’t know” as unsatisfactory. On one level this makes sense. The whole purpose of these systems is to provide answers, after all. But rather than causing the AI to return and rethink its data, it instead developed increasingly convincing answers that were not true whatsoever, to the point where the human supervisors didn’t flag sufficiently convincing answers as wrong because they themselves didn’t realise that they were wrong. The result is that “the more difficult the question and the more advanced model you use, the more likely you are to get well-packaged, plausible nonsense as your answer.”

Uncovering some of what is going on in AI systems dispels both the fervent hype that artificial intelligence might be our saviour, and the deep fear that it might be our societal downfall. This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality. Whether it is used for good or ill depends on the approach of the humans that use it.

But this study also uncovers our strained relationship with ignorance. Problems arise in the answers given by systems like ChatGPT because a convincing answer is valued more than admitting ignorance, even if the convincing answer is not at all correct. Because the AI has been trained to avoid admitting it doesn’t know something, all of its answers are less reliable, even the ones that are actually correct.

This is not a problem limited to artificial intelligence. I had a friend who seemed incapable of admitting that he didn’t know something, and whenever he was corrected by someone else, he would make it sound like his first answer was actually the correct one, rather than whatever he had said. I don’t know how aware he was that he did this, but the result was that I didn’t particularly trust whatever he said to be correct. Paradoxically, had he admitted his ignorance more readily, I would have believed him to be less ignorant.

It is strange that admitting ignorance is so avoided. After all, it is in many ways our default state. No one faults a baby or a child for not knowing things. If anything, we expect ignorance to be a fuel for curiosity. Our search for answers begins in the recognition that we don’t have them. And in an age where approximately 500 hours of video is uploaded to YouTube every minute, the sum of what we don’t know must by necessity be vastly greater than all that we do know. What any one of us can know is only a small fraction of all there is to know.

Crucially, admitting we do not know everything is not the same as saying that we do not know anything.

One of the gifts of Christian theology is an ability to recognize what it is that makes us human. One of these things is the fact that any created thing is, by definition, limited. God alone is the only one who can be described by the ‘omnis’. He is omnipotent, omnipresent, and omniscient. There is no limit to his power, and presence, and knowledge. The distinction between creator and creation means that created things have limits to their power, presence, and knowledge. We cannot do whatever we want. We cannot be everywhere at the same time. And we cannot know everything there is to be known.

Projecting infinite knowledge is essentially claiming to be God. Admitting our ignorance is therefore merely recognizing our nature as created beings, acknowledging to one another that we are not God and therefore cannot know everything. But, crucially, admitting we do not know everything is not the same as saying that we do not know anything. Our God-given nature is one of discovery and learning. I sometimes like to imagine God’s delight in our discovery of some previously unknown facet of his creation, as he gets to share with us in all that he has made. Perhaps what really matters is what we do with our ignorance. Will we simply remain satisfied not to know, or will it turn us outwards to delight in the new things that lie behind every corner?

For the developers of ChatGPT and the like, there is also a reminder here that we ought not to expect AI to take on the attributes of God. AI used well in the hands of humans may yet do extraordinary things for us, but it will not truly be able to do anything, be everywhere, or know everything. Perhaps if it was trained to say ‘I don’t know’ a little more, we might all learn a little more about the nature of the world God has made.

Article

Belief

Change

13 May 2024

6 min read

What makes a journey a pilgrimage?

Travel may broaden the mind, but pilgrimage can nourish a soul.

Graeme Holdsworth

Graeme is a vicar of Marsden and Slaithwaite in West Yorkshire. He also cycles and juggles.

A country lane runs down a gentle hill between green and yellow fields under a cloud dappled sky.

The fields of Hertfordshire

Graeme Holdsworth.

On the recent anniversary of Chaucer’s pilgrims setting off to Canterbury, the British Pilgrimage Trust held a symposium on apocalyptic pilgrimage and spiritual tourism, in a London church – St James Clerkenwell. Nick Jones, the Editor of Seen & Unseen knows of my predilection for a spiritual aspect to travel, and recommended I go along. The only problem with his recommendation was that I live in West Yorkshire, and London seemed like an expensive journey for an evening sat quietly on church pews.

My nearest church is St James in Slaithwaite, and as St James is the patron saint of pilgrimages, it seemed obvious to turn the journey into a pilgrimage. The shortest walking distance is 185 miles and would take me a month to walk. Kosuke Koyama wrote that the speed of love is three miles an hour, the speed God walks. However, God has an eternity to travel, and I had to be back to lead Holy Communion the following Sunday. Cycling (the cheapest, easiest, and finest form of travel) would take me two days, if I took it easy and stayed in a hotel halfway.

I love the isolation of these high places, the wilderness-ness; it is a place for crying out, and place where only God is listening.

Not every journey is a pilgrimage. Sometimes people are just travelling. What would make this a pilgrimage rather than simply a long bicycle ride? I believe it is the intention of the heart that makes the difference - what are pilgrims hoping to achieve? Travel tends to broaden the mind, but a pilgrimage is something that might nourish a soul. There is no suggestion that every pilgrimage is religious, but when people undertake pilgrimages they are making a statement that they’re looking for something beyond themselves. For those who are religious, they’ve made space to meet God in the full knowledge that they may be disappointed. Dr Paula Gooder wrote that Christian faith sometimes focusses rather heavily on the state of a person’s soul, neglecting the state of their body. I hoped to enjoy some beautiful cycling, to re-engage with physical-prayer, and to worship God with my heart, soul, mind and strength in a whole body way. Racing cyclist Jens Voigt famously said, “Shut up legs” when the lactic acid began to burn, but what if my legs are speaking a non-verbal language understood by their creator God? Then let them shout: let the hydrolysis of adenosine triphosphate be my body praying ceaselessly, without words.

The beginning of my pilgrimage took me south and east along the edge of the Peak District. In my planning I had relied on cycling heat-maps to find the roads cyclists preferred. As I climbed a steep hill, I remembered that cyclists are a stupid bunch who often go out and find the hardest roads to cycle. I paused for breath at the top of the climb from High Bradfield; where the Agden, Dale Dike, and Strines reservoirs were stacked up into the distance, and the call of peewits pierced through the noise of the wind. I love the isolation of these high places, the wilderness-ness; it is a place for crying out, and place where only God is listening.

Bolsover castle was the last serious climb of the day, and from this point on the landscape became a lot gentler. Along the ridge after Bolsover, skirting around the west of Mansfield, I noticed the call of Skylarks, and that the fields had changed from drystone walled moorland to green and yellow crops, surrounded by hedgerows. Houses now had thatched roofs rather than the slate tiles of West Yorkshire. I also began to notice churches: Cottage-core villages with pretty gardens and pubs-on-the-green, their church buildings that seem well-kept, giving rural communities a sense of identity. It was around 7pm when I reached a Peterborough hotel.

Pilgrimages are often built around the destination, but I’ve found a real joy in the interim moment; the time between setting off and arriving.

Getting up in the morning after a long day of physical exercise is not easy. Although this day would bring an end to my mini-pilgrimage, I was looking forward to the symposium and meeting other pilgrims. Evensong at St Paul’s Cathedral was to begin at 5pm, and needed an early start to make sure I would arrive in time.

I passed a roadside marker with the distances to Huntingdon and London painted black on a white stone. The Milestone Society’ seeks to preserve these way markers which have a history stretching back to Roman times. I felt a sense of historical connection to those who would have travelled before me.

There was next to no traffic and I was alone with my thoughts and the songs I sing to myself when I’m happy. One of the lovely things about cycling is the activity itself: we’re doing the thing we want to do, and when we’ve finished we will no longer be doing the thing we want to do. Pilgrimages are often built around the destination, but I’ve found a real joy in the interim moment; the time between setting off and arriving.

Hopes and fears for the year

Graeme Holdsworth

Standing on the cold threshold of a new year, Graeme Holdsworth recalls past audacity and whether his aspirations are too timid.

01 January 2024

3 min read

The traffic was increasing as I closed in on London, and I noticed another change in the housing. Here in the home counties the houses were getting a lot larger, further back from the road, and protected by gates and security systems. The sense of community that came from closely packed thatched cottages around an ancient church building was disappearing. Then suddenly there was an exponential shift in the cycling experience as I entered Enfield: cars, scooters, cyclists, motorbikes. The sound, and visual intensity of city living humanity swamped my senses.

I’m glad I didn’t just catch a train to London. I felt that I’d remembered the diversity of English countryside, the freedom of long-distance cycling, and made connections with like-minded pilgrims. I also refreshed my spiritual practice of physical prayer, and time alone with God in the wilderness.

It was about 2:30pm when I checked into my hotel near Kings Cross, unpacked the clothes I’d brought with me and freshened up before taking a walk south to the Thames embankment. After a pie and pint in a London boozer, on the banks of the River Thames, I walked to St Paul’s Cathedral for Evensong, then joined a walking-pilgrimage back to St James in Clerkenwell. St James Slaithwaite to St James Clerkenwell completed, arriving in time for The British Pilgrimage Trust’s symposium of talks and singing. Among the wonderful speakers, it was a delight to hear historian Tom Holland as he spoke to the apocalyptic call: to be a pilgrim.

He spoke about Chaucer, pandemics, black death, and the community aspect of pilgrimages. He joked that academic historians tend to be squeamish about attributing too much credit to religious or spiritual experiences as driving forces behind historical events. However, spiritual and religious drivers are significant: in 1033 there was a massive pilgrimage from all over Europe to the holy land, which came with an apocalyptic anxiety as 1,000 years had passed since the death and resurrection of Jesus. I reflected that contemporary anxiety of apocalypse is less focussed on the return of Christ and more on trigger happy world leaders in Russia, Israel and Iran…but I wonder if there will be a similar Christian pilgrimage in 2033.

Read a full account of Graeme’s pilgrimage ride on his blog.

Find out more about the British Pilgrimage Trust’s routes and resources.