Whether it's AI or us, it's OK to be ignorant

Our search for answers begins by recognising that we don’t have them.

Simon Walters

Simon Walters is Curate at Holy Trinity Huddersfield.

A street sticker displays multiple lines reading 'and then?'

Stephen Harlan on Unsplash.

When was the last time you admitted you didn’t know something? I don’t say it as much as I ought to. I’ve certainly felt the consequences of admitting ignorance – of being ridiculed for being entirely unaware of a pop culture reference, of being found out that I wasn’t paying as close attention to what my partner was saying as she expected. In a hyper-connected age when the wealth of human knowledge is at our fingertips, ignorance can hardly be viewed as a virtue.

A recent study on the development of artificial intelligence holds out more hope for the value of admitting our ignorance than we might have previously imagined. Despite wide-spread hype and fearmongering about the perils of AI, our current models are in many ways developed in similar ways to how an animal is trained. An AI system such as ChatGPT might have access to unimaginable amounts of information, but it requires training by humans on what information is valuable or not, whether it has appropriately understood the request it has received, and whether its answer is correct. The idea is that human feedback helps the AI to hone its model through positive feedback for correct answers, and negative feedback for incorrect answers, so that it keeps whatever method led to positive feedback and changes whatever method led to negative feedback. It really isn’t that far away from how animals are trained.

However, a problem has emerged. AI systems have become adept at giving coherent and convincing sounding answers that are entirely incorrect. How has this happened?

This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality.

In digging into the training method for AI, the researchers found that the humans training the AI flagged answers of “I don’t know” as unsatisfactory. On one level this makes sense. The whole purpose of these systems is to provide answers, after all. But rather than causing the AI to return and rethink its data, it instead developed increasingly convincing answers that were not true whatsoever, to the point where the human supervisors didn’t flag sufficiently convincing answers as wrong because they themselves didn’t realise that they were wrong. The result is that “the more difficult the question and the more advanced model you use, the more likely you are to get well-packaged, plausible nonsense as your answer.”

Uncovering some of what is going on in AI systems dispels both the fervent hype that artificial intelligence might be our saviour, and the deep fear that it might be our societal downfall. This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality. Whether it is used for good or ill depends on the approach of the humans that use it.

But this study also uncovers our strained relationship with ignorance. Problems arise in the answers given by systems like ChatGPT because a convincing answer is valued more than admitting ignorance, even if the convincing answer is not at all correct. Because the AI has been trained to avoid admitting it doesn’t know something, all of its answers are less reliable, even the ones that are actually correct.

This is not a problem limited to artificial intelligence. I had a friend who seemed incapable of admitting that he didn’t know something, and whenever he was corrected by someone else, he would make it sound like his first answer was actually the correct one, rather than whatever he had said. I don’t know how aware he was that he did this, but the result was that I didn’t particularly trust whatever he said to be correct. Paradoxically, had he admitted his ignorance more readily, I would have believed him to be less ignorant.

It is strange that admitting ignorance is so avoided. After all, it is in many ways our default state. No one faults a baby or a child for not knowing things. If anything, we expect ignorance to be a fuel for curiosity. Our search for answers begins in the recognition that we don’t have them. And in an age where approximately 500 hours of video is uploaded to YouTube every minute, the sum of what we don’t know must by necessity be vastly greater than all that we do know. What any one of us can know is only a small fraction of all there is to know.

Crucially, admitting we do not know everything is not the same as saying that we do not know anything.

One of the gifts of Christian theology is an ability to recognize what it is that makes us human. One of these things is the fact that any created thing is, by definition, limited. God alone is the only one who can be described by the ‘omnis’. He is omnipotent, omnipresent, and omniscient. There is no limit to his power, and presence, and knowledge. The distinction between creator and creation means that created things have limits to their power, presence, and knowledge. We cannot do whatever we want. We cannot be everywhere at the same time. And we cannot know everything there is to be known.

Projecting infinite knowledge is essentially claiming to be God. Admitting our ignorance is therefore merely recognizing our nature as created beings, acknowledging to one another that we are not God and therefore cannot know everything. But, crucially, admitting we do not know everything is not the same as saying that we do not know anything. Our God-given nature is one of discovery and learning. I sometimes like to imagine God’s delight in our discovery of some previously unknown facet of his creation, as he gets to share with us in all that he has made. Perhaps what really matters is what we do with our ignorance. Will we simply remain satisfied not to know, or will it turn us outwards to delight in the new things that lie behind every corner?

For the developers of ChatGPT and the like, there is also a reminder here that we ought not to expect AI to take on the attributes of God. AI used well in the hands of humans may yet do extraordinary things for us, but it will not truly be able to do anything, be everywhere, or know everything. Perhaps if it was trained to say ‘I don’t know’ a little more, we might all learn a little more about the nature of the world God has made.

Voting is much more than a token gesture

The political practice can capture something heavenly.

Joel Pierce

Joel Pierce is the administrator of Christ's College, University of Aberdeen. He has recently published his first book.

A sign reading 'polling station' stands by the entrance to a church.

What makes an act sacred? Who it excludes, or who it welcomes? I found myself pondering this looking at the thin metal discs in the box I’d pulled off the shelf. I’d seen their tagged under glass at Scotland’s National Museum. Now, in an archive housed in the old kitchen of our rural community’s school, I had my first chance to touch what was once called “the open sesame to the bliss of so great a mercy”, a Church of Scotland communion token. Now items for collectors, filling drawers in local history museums, they once were the necessary payment for participation in one of the rites at the heart of Christian worship. They were the coin that verified that its holder’s faith and morals had been examined by an elder of the kirk and been found satisfactory.

Holy Communion, or the Eucharist as it is called in other churches, has its origins in the Last Supper, a meal of bread and wine Jesus shared with his disciples on the night before his crucifixion. Christians may disagree on the exact meaning of the meal, but all hold that it is, in some way, sacred and central to the Christian life and the recognition and celebration of Christian community. Communion tokens were but one example of a strategy that Christians have employed time and again to ensure that the mystery and sacrality of the meal is properly recognised: stopping the wrong sorts of people from participating in it. Ironically, in this we have often been much more discerning, or perhaps discriminating, than Jesus himself. The companions he chose to initiate the practice were a quarrelsome lot. They were mostly provincial fishermen more concerned with establishing their place in the new kingdom they imagined Jesus would establish after overthrowing the Romans than in participating in the meal with due reverence and seriousness.

All who came were for that day, in that room, in that act, equal. All who came were welcome. No one was turned away.

A year later, I found myself sitting behind a table in the rear of our community’s nursery. It was election day for the Scottish Parliament, and I had added polling clerk to the miscellany of part-time jobs I had taken after finishing my studies. We had all arrived early to ensure that we had time to wrestle enough string and cable ties together to secure the polling station sign around the ancient tree that marked the entrance of the nursery’s car park before polls opened at 7am. It was the first, and only time I have worked a sixteen-hour day, and my exhaustion at the end of it probably contributes to much of it being a bit of blur. What I do remember is the flow of people: mums in smart blouse and skirt combinations with kids in tow, fitting us in first thing before a stop by the childminder’s on the way to the office; tradespeople and farmers catching us between jobs, their trousers still spattered with paint or mud; scions of the local aristocracy; proud parents bringing teenagers to vote for the first time once the school day ended; a couple with a young baby, asleep for now, arriving just before closing, “We’re not too late are we?”.

My fellow poll workers, two old hands, knew most of our customers by sight. I knew a few, mainly other parents I had met during school and nursery drop-offs, but it didn’t matter as the rite was the same for all. They would approach the table, give us their name and address, and once a line was drawn through them on our roll, they were given the elements, two ballots, one to vote for their constituency Member of the Scottish Parliament, and another to vote for their preferred party. All who came were for that day, in that room, in that act, equal. All who came were welcome. No one was turned away. All that was needed was their word that they were who they said they were. Once the ballots were completed, we made sure they put each in the correct ballot and then they were out the door, on to the rest of their day.

Perhaps it is also true that sometimes, as much by accident as intention, we happen upon a form or practice in our shared political life which captures something of heaven.

As someone who did my first voting in the United States, I was a little stunned the first time I cast a ballot in the UK. Instead of having to use a black ink pen to assiduously fill in ovals on a ballot that felt like an extended multiple-choice test, all I needed to do was make a single penciled ‘X’ on a half sheet of coloured paper and make sure it wound up in the secure box. Was that it?

As I’ve reflected on that experience and had a few more goes of voting here, I have come to appreciate the elegance of the British approach. Instead of making the voter feel like an overwhelmed bureaucrat having to make a couple dozen underinformed choices on matters as diverse as national representatives, state laws, school boards, and local ordinances, the simplicity of the UK ballot means that what is centred is the social meaning of the act itself. We may be differentiated on all other days by class, culture, income, region, or football club allegiance, but in this act we come as close in our political practices as we ever do to touching something which Christians know, something which Christians sometimes see as they share Communion, that all these distinctions are ultimately passing, that beyond them each one of us is imbued with a dignity which the greatest worldly failure cannot take away from us and to which the greatest worldly success cannot add.

There is a school of thought in political theory which says that all our most important political concepts are actually secularised theological ones. They say, for example, that our exalted ideas of state sovereignty find their origins in our forebears’ understanding of God’s. Theologians draw various lessons from this approach, some worrying that what it really reveals is that we have made an idol of the state. They may be right, but perhaps it is also true that sometimes, as much by accident as intention, we happen upon a form or practice in our shared political life which captures something of heaven. It is not wrong, I think, to accord such secular practices a certain level of sanctity. It is not wrong to call the principle of ‘one person, one vote’ in some sense sacred.

No longer are we allowed to trust that people are who they say they are. They are assumed to be imposters until they produce a piece of paper which says otherwise.

But once that sacredness has been granted, we face a very similar problem to the one faced by those early Scottish reformers regarding Communion. How do we ensure this sacredness is protected, that it does not become debased? A traditional answer has mirrored the reformers’ approach to communion: erecting hurdles to ensure that only the truly worthy are allowed to participate. The unmaking of this approach has been the slow work of centuries as the franchise was eventually extended down the social and property ladder to all male citizens and, then, belatedly, to all women as well. What I experienced at the polling station that day was a miracle secured by many years’ of struggle, reform, compromise, and collective recognition that what has made this act sacred is not its exclusion, but its welcome. In this it has mirrored the welcome of most contemporary Communion services in the Church of Scotland where participants are, to be sure, asked to approach the act soberly, having examined themselves and made confession to God, but where the default is to trust that people have done so. No longer are people considered unworthy until proven otherwise by their possession by a metal disc.

When I first heard of the possibility of the introduction of Voter IDs at polling places, my mind immediately flew to how such laws were aimed in the United States. Like here, there is little to no actual evidence of voter fraud there, but in a country where the archaic system of the Electoral College means a few thousands votes in the right state can decide a presidential election, there is a real threat that such laws will sway election results. Here the influence of such laws is less clear. While they do seem to have a small effect of driving down participation, at last year’s local elections four pre cent of eligible non-voters cited the ID requirement as the reason they did not vote, recent election results have not been dramatically out of step with opinion polling.

What I do worry about losing with these laws is a little bit of the elegance and dignity which has previously imbued the UK system. No longer are we allowed to trust that people are who they say they are. They are assumed to be imposters until they produce a piece of paper which says otherwise. It is a small change, but one which nudges the rite closer to being just one more bureaucratic transaction, a bit more like picking up a package or going to the bank, than one of our most important public rites. It is a precaution that seeks to preserve the sacredness of the act, but is chipping away at what it is that makes it sacred.
If I wind up working in a polling station on July 4th, I will dutifully check every voters’ ID prior to handing them a ballot. I will send friends and neighbours home to get theirs if they’ve forgotten it. I will be careful to bring my own. I am sure if I had lived in former times in Scotland, I also would have been careful to remember to take my communion token to church. Those are the rules of admittance and the rite is too important to skip. However, I will mourn a little for what has been lost and hope for more places where we recognize the possibility of the sacred dwelling in our practices of welcome, recognition, and trust rather than exclusion.