What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre

A digital momento mori.

Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this?

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out.

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans.

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct?

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness.

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality.

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality.

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality.

Article

Culture

Mental Health

Music

25 October 2024

5 min read

Dark, sweet and subtle: recovered music orientates us

The alt-folk music seeking inspiration from forgotten hymns.

Jonathan Evens

Jonathan is Team Rector for Wickford and Runwell. He is co-author of The Secret Chord, and writes on the arts.

A woman stand at a mixing desk playing a small keyboard.

Lleuwen Steffan plays.

In 2012, musician Lleuwen Steffan first came across a trove of lost Welsh folk hymns preserved in the sound archive of St Fagan’s Museum. Knowing they were not in current hymn books, she undertook further research and discovered they had been excluded from earlier hymn books by the then all-male hymn book committees of their time. Instead, they had been passed on orally, and, although recorded for St Fagan’s by the historian Robin Gwyndaf, had become lost with time and secularization.

Steffan was particularly attracted to these hymns as many dealt with the dark side of the psyche including addiction and mental distress. She has said that many of these hymns, some of which date back to the eighteenth century, are “conversational and the lyrics feel so current”. She is currently taking these hymns back to where they were born through a tour of 50 chapels in Wales but this is not an exercise in nostalgia as her focus is on their contemporary resonance: “Musically, I’m not interested in recreating something from the past. That’s missing the point. Yes, the words are old but the message is always new. The music is free form.”

Although the subject matter of these hymns will have been part of the reason for their exclusion from the hymn books of their day, that same subject matter has been part of worship songs from the time of the Psalms to the present. The Psalms are the worship songs of the people of Israel as recorded in the Old Testament and are the first occasion in ancient literature where the voice of victims is heard and valued.

The Old Testament scholar Walter Brueggemann in his book Spirituality of the Psalms provides an insightful and structured overview of the Psalms using three categories: orientation, disorientation, and new orientation. Orientation is the establishment of structure and order. Disorientation is a place of imbalance and nonsense, which is potentially unjust. New orientation is moving forward away from what was and toward new possibilities. As a result, the Psalms provide us with expressions of suffering and hope in the seasons of everyday life. In his book, Brueggemann explains how Psalms of negativity, cries for vengeance, and profound penitence are foundational to a life of faith, and establishes that the reality of deep loss and amazing gifts are held together in a powerful tension.

“This eerie, intriguing and enchanting music... is infused with echoes of the past two centuries’ beliefs and threads of spirituality and song.”

Rupert Loydell

With such a collection of worship songs as the foundation of worship in churches, and with plainsong in Western churches providing a means by which to chant the Psalms on a daily basis, it should not be surprising that later hymns, such as those being reimagined by Steffan, tap into the dark side of the psyche. The success of albums such as Officium by saxophonist Jan Garbarek and The Hilliard Ensemble, together with Steffan’s own collaboration with pianist Huw Warren and saxophonist Mark Lockheart on Welsh hymns Duw A Wyr (God Only Knows) which is in a similar vein, show how such music can be made relevant to contemporary audiences.

Ghostwriter’s latest album, Tremulant, inhabits similar sonic territory to Steffan’s current Tafod Arian (Silver Tongue) music. Created over several years by Mark Brend, Suzy Mangion, Andrew Rumsey and Michael Weston King, this album has also been borne out of a shared love of antique evangelical hymns and spiritual songs. Using English, Welsh, Scottish and American source material from the nineteenth and early twentieth centuries, the quartet pieced together their reconstructed hymnal through remote collaboration – creating an album that sounds both ancient and modern.

In his review of Tremulant, Rupert Loydell says it is “a strange ambient gospel album, where what used to be called spirituals and hymns are subverted by echo, wheezing organ and spacious musical interludes, which recontextualise, reimagine, stretch and mutate the very idea of song”. This, he says, “is eerie, intriguing and enchanting music” with “echoes of classic Nico (the cold beauty of Desertshore)”. It's ”declamatory poetry, alt-folk, noise and gentle discord” combined with “calm vocals” is “infused with echoes of the past two centuries’ beliefs and threads of spirituality and song”. As such, it's not what you’ll hear the local worship band playing, more’s the pity!

“Something kept bringing me back. That something has always been there. For that I am extremely thankful and am listening to it more and more.”

Lleuwen Steffan

Like buses, other revisiting’s and reimagining’s of old hymns and gospel songs are also coming along together. Hymn Time In The Land Of Abandon by Over the Rhine is “Music that we grew up singing, music as present in our formative years as the air we breathed”. Their recordings of hymns have been described as “spare, sweet and subtle renderings that transform the familiar into something fresh and new”.

The musical reimaging involved in Over the Rhine’s reinterpretations of hymns takes them into the space that Brueggemann defines as new orientation, while the sounds and, in some cases, content of the hymns chosen by Steffan and Ghostwriter are more in the realm of his disorientation category. The music making of Lleuwen Steffan, Ghostwriter and Over the Rhine takes us to places not commonly accessed by the music used in many church services. As is indicated by the story of hymn book committees omitting hymns that tap into the dark side of the psyche, much of the music used in church services can be located firmly in either the orientation or, sometimes, the new orientation categories.

Given that the arc of Christ’s life, death and resurrection takes us on a similar journey to that which Brueggemann sees occurring in the Book of Psalms, when our music and liturgy fail to go on a similar journey, we are only encountering part of the meaning and message of faith. The recent music of Lleuwen Steffan, Ghostwriter, and Over the Rhine is therefore profoundly helpful in beginning to redress that loss of balance in worship by taking us back to a fuller appreciation for the original songbook of the faithful, the Book of Psalms.

In speaking about why she has been drawn again and again to church music, Steffan described her teenage experience of drinking with her “mates in Bangor on the Saturday night” then getting “the last bus back home” and rolling “out of bed the following day to go to Sunday School”. She concluded: “That’s a strange paradox but, you see, something kept bringing me back. That something has always been there. For that I am extremely thankful and am listening to it more and more.” It may well be that that something is the arc of orientation, disorientation and new orientation we encounter and experience in the Psalms.