What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre

A digital momento mori.

Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this?

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out.

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans.

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct?

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness.

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality.

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality.

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality.

Review

Books

Culture

Ethics

Film & TV

8 November 2024

4 min read

Small Things Like These: putting the spotlight on backstage goodness

What it means for a film to be good.

Kevin Hargaden

Kevin is a social theologian studying ethics and economics.

The gaunt face of a dishevelled man stares into the distance

A ‘stellar’ Cillian Murphy plays Bill Furlong.

Lionsgate.

Small Things Like These is a novella by the Irish writer Claire Keegan. Published in 2021, it compresses a remarkable story into 128 pages. Acclaimed widely by critics and readers, it follows Bill Furlong, a fuel merchant living in the small County Wexford town of New Ross in 1986, as Christmas approaches. While delivering coal to the local convent, Bill makes an alarming discovery. Memories of his childhood begin to press in on him and he finds himself in an existential crisis.

Like her previous (very short) work, Foster, Small Things Like These is an understated book with a searing moral clarity. And just as Foster was adapted for the screen – in the astonishing Irish-language film The Quiet Girl – a movie version of Small Things Like These is now likely showing at a cinema near you.

The movie is built around a stellar performance from Cillian Murphy. It would be criminal if his name is not featured among the shortlists when awards season comes round. Many of the film’s most arresting scenes feature close-ups of his face as Bill wrestles with the implications of his discovery and the phantoms of his past. The effect is that the film serves as an almost literal portrait of what it means to be a decent person.

The story begins with Bill making a delivery to the convent. He sees a mother drop off her screaming daughter to the back door, where she is met and manhandled inside by a nun. The teenager protests passionately, but to no avail. The viewer understands that this girl has “fallen pregnant”, to use the Hiberno-English idiom that was so common in the twentieth century. She has been dispatched by her family to this institution to serve out the months of pregnancy and to remove any shame or taint from their reputation. Bill watches as the girl shouts out for her father, who is entirely absent.

And, after a tense interaction with an aggressive nun, he goes home to his five girls and his wife, clearly shaken.

A few days later, unable to sleep, haunted by memories of his own childhood being raised by a single mother, with an absent father, relying on the kindness of a wealthy local landowner, he begins his deliveries before dawn. As he deposits peat briquettes in the coal shed of the convent, he discovers a teenaged girl abandoned in the corner of the tiny, filthy room. She is in deep distress and Bill responds instinctively, wrapping his coat around her shoulders and bringing her inside to the convent.

While the existence of Magdalene Laundries and Mother and Baby Homes were not a secret in twentieth century Ireland, the exact details of their operations were not widely understood. With these two encounters, so close together, and his own personal biography as the son of a woman who was subject to exactly the same marginalising dynamics, Bill can no longer be satisfied to turn a blind eye to the oppression and alienation endured by those sent for reformation.

It evokes the ways in which all such systems of oppression are socially constructed and maintained. Otherwise, good people learn to look the other way.

The film gathers momentum as Bill is forced to confront the way his mother had been treated for “falling pregnant” and the reality experienced by girls the same age as his daughters who were in a similar situation. In the midst of his existential angst, he finds little solace in the no-nonsense pragmatism of his wife who reminds him “there are things you have to ignore” to get on in life. He is taken aside by his local publican, a woman who has similarly scrabbled up from humble origins to establish a thriving business and cautioned to not make trouble for the nuns since “their fingers are in every pie in the town”.

I will refrain from fully revealing every detail of the film’s plot. But this element of the screenplay – where Claire Keegan along with Enda Walsh – draw out the sense in which the oppressive ecclesial institutions were enabled and even sanctioned by the wider population is exceptionally well done. The film does not pull any punches on the evils that were committed in the name of churches in Ireland. Indeed, if anything, the presentation of the nuns veers too far towards caricatures of pure malevolence. But with surgical precision, it evokes the ways in which all such systems of oppression are socially constructed and maintained. Otherwise, good people learn to look the other way.

And that is the lasting significance of this film. Toni Morrison has spoken about how it can seem harder to write about goodness than evil. “Evil has a blockbuster audience; goodness lurks backstage.” In Small Things Like This, Claire Keegan introduces us to a hardworking small business owner who treats his staff well, a loving father who seeks to care for his wife, a man who lives down a back street of a provincial town in an overlooked part of a small island on the periphery of Europe. And in this very definitively backstage context, he is presented as heroic in his pursuit of the Good.

We all fancy ourselves to be the one person who would stand up and oppose systems of oppression if we ever found ourselves enmeshed in them. Cillian Murphy’s depiction of Bill Furlong whispers to us that we likely are enmeshed in just that way and are choosing not to notice. Small Things Like These is a heavy film that somehow liberates. It reminds us that there is, within each of us, this appetite for seeing the Good and bring brave enough to do it. It is worth your time far more than any competing blockbuster.