Article
AI
Culture
5 min read

What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre
A digital momento mori.
Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this? 

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. 

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct? 

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness. 

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)  

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.  

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality. 

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality. 

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality. 

Review
America
Books
Culture
Politics
8 min read

James Davison Hunter: diagnosing America’s health

A great experiment is depleted, and nihilism slips into the void.

Roger is a Baptist minister, author and Senior Research Fellow at Spurgeon’s College in London. 

Riot police stand guard outside a White House fence line.
The White House, June 2020.
Angela N., CC BY 2.0, via Wikimedia Commons.

It was unsettling. Disturbing. And in the months since, it has proven to be a powerful and haunting image, etched in my memory. Thinking about it now has exactly the same chilling effect. 

So, it was earlier this year. I was at the cinema with a friend, sitting comfortably and waiting for our movie to start. Our shared love of Sci-Fi had taken us there that afternoon. Not unexpectedly, up pops the reel of trailers. Fast paced, dramatic and with loads of loud music, they’re either enticingly engaging or mercifully short. 

On this occasion the climax of the reel saw America engulfed in a modern-day civil war. And the image?  

A man is pleading, ‘There’s some kind of misunderstanding here, we’re Americans, okay?’  

There’s a pause. The music stops. Silence. It’s a long pause. 

Then the camera pans to a man in military fatigues, with sunglasses and a rifle sitting ominously on his hip, cocks his head and responds: 

‘Okay … [another pause] what kind of American are you?’ 

Guns cocked, the trailer explodes back into life. 

Our movie was really good. My friend’s company, as usual, was delightfully affable. But the image that remains echoes with that question, ‘what kind of American are you?’ 

I have to confess, I love America. I studied there. I have good friends there. I gorge on American food. I watch American football with my son, every week, on a pay-per-view live stream with real US TV ad breaks (‘Go, Pack, Go!’). In my personal experience Americans are some of the kindest, most thoughtful and most generous of people.  

Maybe that’s why I’ve found the image so troubling. Not that it was some kind of fantastical dystopian depiction, but rather that it portrayed something altogether more plausible. Especially in the light of the ‘storming of the Capitol’ on January 6, 2021, the epidemic of mass shootings and the ongoing violent rhetoric on both sides of the political divide. 

How do you square the circle of America? How do kindness and generosity sit alongside gun violence? Is the country on the brink of civil war? 

Back in 1991 the University of Virginia sociologist James Davison Hunter’s book, Culture Wars: the Struggle to Define America suggested that cultural controversies would be increasingly significant in American politics. At the time not everyone agreed and some even pushed back against such an overblown prediction. Time, however, has vindicated Hunter’s reading of the runes. The ubiquity of his ‘culture wars’ epithet is the proof of his pudding. 

Hunter’s latest offering picks up the story once more. Using the present situation in America as a case study, his reflections ‘bookend’ his earlier thinking. However, Democracy and Solidarity is not an extended commentary exploring the rise of populism and the radical right, or the snowflake, woke elitism of the socialist left. Rather, it seeks to understand why the sentence that opens his preface is true: ‘Democracy in America is in crisis.’ 

Grievance and hurt issue in rage, the unchallengeable moral authority of ‘my personal experience!'

For Hunter, understanding what is going on in a culture requires diving deep into the sources it draws on. What forms it? What drives it? All too easily we focus on the observable and what we can see. The stuff that happens and the values, beliefs and institutions that comprise our common life.  

But that is to miss the deeper structures of culture that are formed by our tacit assumptions and the latent frameworks of meaning that nestle unseen and form the cultural architecture that surrounds us. The power of culture is demonstrated by how far it is taken for granted’. 

In an interview Hunter likened his approach to be the difference between weather forecasts and climate studies. Or, to put it another way, moving from ‘the politics of culture’ to ‘the culture of politics.’ 

Beginning at the beginning, Hunter goes to the origin story of the nation. Deeply influenced by the principles of the enlightenment the Founding Fathers of the United States set about their task of nation building. Proposed by John Adams, Benjamin Franklin and Thomas Jefferson in 1776, the national motto on the Great Seal of the United States, E Pluribus Unum (Out of many, one), summed up their political objective. The creation of solidarity. The glue that binds a society together. 

The genius of the Enlightenment in America was that it facilitated this solidarity. What was created was a ‘Hybrid-Enlightenment’, fusing the insights of French and British intellectuals in a context deeply influenced by the faith of religious dissenters, with the Puritans chief among them. The blending of the secular and faith insights from the Enlightenment was what provided its robust inclusivity and durability. For Hunter, this proved key because: 

“In the end, the hybrid-Enlightenment in America was a broad enough and opaque enough amalgamation to encompass substantial diversity and the tensions that diversity implied.” 

This opacity enabled different groups to see themselves in the enterprise and gave wider American society an ability to absorb a plurality of views, opinions, and traditions. A commitment to Enlightenment rationality also then provided the tools whereby differences could be ‘worked through’ in reasoned debate. Thus, the culture was a living thing, growing, evolving and developing. All the time maintaining the wider solidarity, the ‘buy-in’ from the different communities and constituencies that comprise America. 

Opacity also meant that tensions and contradictions were part and parcel of the endeavour from the start. There may have been a promise of freedom, equality and universal justice for all, yet historically these have been denied to large tracts of the American population. But still the centre held, and solidarity was maintained. As Abraham Lincoln presciently reflected in his Second Inaugural Address, given on March 4 1865, shortly before his assassination and the end of the Civil War: 

“[We] read the same Bible and pray to the same God, and each invokes His aid against the other. … [Yet] the prayers of both could not be answered—that of neither has been answered fully.” 

The problem today, as Hunter discerns it, is that the elements of the hybrid-Enlightenment are unravelling.  He sees a number of contributory causes to this escalating collapse.  

Right at the centre is an amoral, materialistic and individualistic neoliberalism which reduces everything to economics and the market. This is deeply corrosive of community and solidarity.  

Then there is the fruit of postmodern scepticism that has filtered down from the intellectuals into the general population. Truth is deconstructed, experts are distrusted and misinformation, disinformation and fake news abound. 

Widespread immigration also plays a part. It intensifies American pluralism and brings into the country those who are unfamiliar with the legacy of the hybrid-Enlightenment and for whom the national mythos of America is either strange or incomprehensible. Far from being taken for granted, their worldview does not fit. 

The growth of identity politics further complicates the unravelling. Solidarity, rather than being found in the national vision, is achieved by defining ‘us’ over and against ‘them’. It doesn’t foster cohesion, it seeds division. Grievance and hurt issue in rage, the unchallengeable moral authority of ‘my personal experience!’ As with Nietzsche, this acts as a narcotic against the hurt, an anaesthetic for the pain.  

Of course, identity politics has no room for reasoned debate and mutual resolution. All that matters is the outcome of the zero-sum game where the justice of my position is both acknowledged and acted upon, and you lose. Whether that identity falls on the political right or left, it doesn’t matter. Family, sexuality, public education, the news media, the arts, the law, electoral politics, you name the issue the game play is the same. 

Solidarity always involves drawing boundaries. Even the hybrid-Enlightenment drew the line between what was acceptable and what was unacceptable. Who was a part of us, and who was not. Without boundaries there is no identity. It is just that now, identity politics require the boundaries to be much more tightly drawn. “What kind of American are you?” 

In all of this, America’s cultural resources for ‘working through’ these issues have been seriously depleted as the hybrid-Enlightenment has unravelled. Into the void, observes Hunter, a form of cultural nihilism slips in. It is far from being all-pervasive, and he maintains that few Americans are nihilists. Yet as a cultural reality he sees it in the prevailing tendencies towards ‘epistemological failure’, ‘ethical incoherence’ and ‘existential despair’. Then, deriving from these he adds a fourth, ‘political annihilation’ and the will to obliterate everything that obstructs acquiring power by destroying enemies completely. 

Does it all seem rather depressing? 

Hunter admits that he has neither proposals nor a plan to address the crisis he so eloquently describes and accounts for. Yet he concludes: 

“… truth be told, I myself am very hopeful – not because I don’t see the seriousness of the problem and its dangerous implications, but because I believe that the times are full of real opportunity if one has the eyes to see them. Sadly, my eyesight is not very good. … [but] without real images of a better world, without myths of a completion of the past in the future, without a world ordered towards goodness, truth, and beauty … We become something like Nietzsche’s ‘last men’.” 

I’m grateful to Hunter. I think I understand my American friends, their country and their present challenges better for his insights. As for the possibility of a civil war, he thinks it’s unlikely as the ‘red and blue’ are too intermingled and economically interdependent across the country. In the meantime, political violence will continue to be a very real threat. 

As for the future he hopes for, it requires a paradigm shift to imagine and articulate a new vision of public life. It needs the cultural resources of a reconstituted humanism, drawing on the rich insights available in a genuinely pluralist society. Resources that embrace the faith wisdom of exemplars like Martin Luther King, Mohandas Ghandi and Thích Nhất Hạnh. Resources that include a retrieval of the fundamental principle of forgiveness. Without the realism to accept that none of us are perfect, we’ll never be able to live together. As the influential political theorist Hannah Arendt wrote in The Human Condition (1958): 

“Without being forgiven, released from the consequences of what we have done, our capacity to act would, as it were, be confined to one single deed from which we could never recover; we would remain the victims of its consequences forever.” 

Arendt’s insight is altogether more telling when seen in the light of her experience as a German Jew under the Nazis. And if forgiveness is too high a bar, at the very least we have to somehow learn to let things go and move on. 

Hunter is under no illusions, such a paradigm shift remains a long haul away.  

But he is hopeful.