Essay
Comment
Penitence
9 min read

A present focus on future change should trump paying penitence

Reparations are in fashion for compensating for the past argues John Milbank, asking whether taking a stance about the past is more important than achieving an outcome in the present.

John Milbank is a theologian, philosopher and poet. A co-founder of the Radical Orthodoxy movement, he is an Emeritus Professor of the University of Nottingham.

An accounting entry in copperplate writing.
Entry in Queen Anne’s Bounty Accounts showing money received from the executors of Edward Colston.

Reparations are in the news these days. Poland is demanding $1.3trillion from Germany for the destruction to their country by the Nazi’s invasion 84 years ago. The Mayor of New York City Mayor is advocating reparations payouts as a solution to the wealth gap between blacks and whites in the city, and Caribbean countries are considering approaching the United Nation international court of justice for legal advice about reparations for slavery. 

In line with this trend, the Church of England intends to spend £100m on reparations for its past involvement in slavery.  

As many have already pointed out, the receipt of any money from slavery profiteering was minimal and marginal at best, such that the rationale given for this intention involves a strange exaggeration of its own past faults.  

The problem with this is that it implies a kind of boasting about its sins, which is itself a mode of sin, all too akin to the agreeable shudders produced when a supposedly repentant sinner details his past wrong doings before the altar. The greater the lapse, the greater the grace, in a kind of gross liberal parody of an already gross exaggeration of a more authentic Protestant legacy.  

Why should the Church seek to do this? The answer surely is nothing to do with its reckoning with its own past shortcomings. It is rather the same old courting of middle-class respectability that has always afflicted Anglicanism at its worse, despite entirely opposite tendencies of which it can be proud. Reparations are fashionable in middle class circles and the Church wants to be in on the act. One should not mistake this for radicalism, nor for real repentance. If the West was really sorry for what it has done wrong in the past, it would not pretend that this wrong was not mixed up with a lot of good (in the case of overseas empires for example) but would seek in the present to act in an entirely different way: to abandon economic and ecological exploitation of the rest of the world in the present, and to seek to act always in a globally collaborative manner.  

Rather than seeking to change the present, it is far easier to continue to condemn the past, which cannot seriously be undone. 

The reasons it does not do so concern not only its continued commitment to an unqualified capitalism, but also and more subtly the truth that if we seriously wished to act positively and helpfully, we would have to resume some of our past paternalistic concern in a new idiom, that would no doubt prove unacceptable to a now liberal-dominated left. Increasingly, respectable liberal opinion cares far more about formal stances than about actual beneficent outcomes.  

Rather than seeking to change the present, it is far easier to continue to condemn the past, which cannot seriously be undone. Financial compensation is itself a substitute for any real change of heart. For if we really regretted past exploitation, we would not continue to sustain it in a less involved and more purely economic, and therefore worse form today.  

Furthermore, to imagine that one can set a price on damaged heads is only to repeat the quantification and monetarisation of humanity that was the logic of slavery in the first place. The fact that so many non-white people nonetheless back the call for reparations is only a sad proof that they are covertly locked into a capitalist logic and a liberal-rights thinking that tends to tilt over into the unchristian (despite Nietzsche) ethics of ressentiment.  

Rather, one should say that our involvement in the Atlantic slave trade was so bad that nothing can offset it, save the sacrificial blood of Christ (recalling that he was betrayed for money) and our sharing in this atoning action through repentance and compensatory, embodied action in the present.  

So why on earth would the Church of William Wilberforce and Trevor Huddleston feel that it needs to regret its supposed slave owning and racist past? 

This was initially and most of all demanded and carried out by Anglicans of a usually High Tory persuasion, and though we should not forget some enlightenment opposition to slavery, which sometimes inspired the revolt of slaves themselves, it is an illusion not to consider this to be also Christian or at least post-Christian. After all, pagan republicans were not just at ease with slavery, they built their entire republican systems upon it. To a degree the United States tried at first to repeat that, till eventually a radical Christian vision (taking it beyond the qualified Biblical acceptance of slavery) won out in that country also, though it lagged in this respect behind Britain and the Anglican Church. 

So why on earth would the Church of William Wilberforce and Trevor Huddleston feel that it needs to regret its supposed slave owning and racist past?  

One might say that it is more important to feel shame and regret than to boast. But to celebrate one’s past saints is not to boast of oneself, but to accord honour where honour is due and to raise up admirable examples for admiration and imitation. To be human and to be creative in the image of God is continuously to praise as well as to blame, as the Anglican poet Geoffrey Hill frequently argued.  

Moreover, if we only follow fashion in our blaming, which is also important, then we will tend to miss the more hidden and subtle culpable targets. Uncovering the latter is surely especially incumbent upon anyone claiming to follow Christ, who constantly located sin where it was unsuspected and inversely found hidden if suppressed virtue to be present amongst those publicly deemed to be sinners.  

In reality our coming to see the Good is always the work of time and is always revisable. 

But in the case of both praise and blame what matters most is to take the drama of past history as instructive: not to claim that we can finally undo its past injustices as past. This is blasphemously to appropriate the prerogatives of God at the last judgement and to newly extend the false logic of sacramental indulgences.  

For a kind of unspoken presentism lurks behind the reparations mentality. The assumption is that we all really live in an ahistorical eternity within time, such that if we were always thinking rightly we would always see, in any time or place, the truth of current liberal nostra, despite the fact that they are themselves incessantly changing, for example with respect to gender and sexuality.  

In reality our coming to see the Good is always the work of time and is always revisable. What the Greeks and Romans regarded as acceptable treatment of ‘barbarians’, women and slaves we can now see to be horrendous, and we are right to do so. And yet it would be a mistake to suppose that classical nobility was a self-delusion: by their own lights people in antiquity acted virtuously and in certain ways which we can still recognise today, with regard to fortitude, magnanimity, forbearance and so forth. We can also allow that they developed acceptable notions of virtue in general, even if they filled them with often highly questionable content. 

In the case of the Bible, the notion that ethical insight changes with time is still more foregrounded than with the pagans. It is a record not just of backsliding, but of constantly new prophetic and visionary insights, culminating in the drastic New Testament revisions of what is ethically demanded of us all the time, even if this is often cast as return to lost origins.  Yet despite this, the forefathers continued to be praised as well as blamed, celebrated as well as condemned, even in the New Testament. 

In the case of both pagan and Jewish antiquity it was realised that even if we can claim to have surpassed our predecessors in insight, our new insights still depend upon their earlier ones, such that we stand upon the shoulders of giants.  

We have then no warrant to condemn people in the past who were good by their lights of their times, including benefactors like Edward Colston of Bristol who were also slave traders, and whose statues should therefore be left to stand. They were perversely blinkered indeed, but they lived in a blinkered age. It is pointless to blame them and more important to praise the rare visionaries who were able to think beyond this. One may say well ‘everyone could have seen the point if some did’ but this is to ignore the truth that most of us usually find such people awkward and that they have not always thought through an alternative way forward. After all, a failure of Northern abolitionists adequately to do that was in part responsible for the continued pervasive misery of African Americans through many decades and continuing today, after the American civil war.  

Everything in time and space is infinitely ramified and ramifying. Absolutely everything is contaminated and yet the bad is interwoven with the good. 

Another problem with reparations is, of course, the problems of identifications and the selectivity involved.  

Just who are the current descendants of slaves and the continued legatees of disadvantage thereby accrued? All African Americans, of every class, despite much intermarriage? All the inhabitants of the Caribbean, again despite social hierarchies? African countries, despite past African complicity in, and indeed originating of, specifically modern slavery?  

And then why only certain selected ethnicities? To focus on only black people looks candidly like supporting a will to power and a reverse anti-white racism. What about all women, and all gay people so mistreated in the past? What about the working classes in Britain whose children were sent down mines and up chimneys under conditions of dependence little better in practice than outright slavery? Are they deserving of compensation? After all, their ancestors are often readily identifiable by both family and region. 

So wherever would one stop? Should Anglo-Saxons demand at last justice from the conquering Normans, since these different ethnic legacies are still somewhat identifiable by class, as anyone suddenly summonsed into the arcanum of old county money lurking within guarded private estates with unimaginably huge old trees, will readily testify.  

Everything in time and space is infinitely ramified and ramifying. Absolutely everything is contaminated and yet the bad is interwoven with the good. If we start to try to break with all of the bad through a sort of Maoist cultural revolution (in relation to the British imperial past, for example) then we will end up losing the fruits and flowers as well as the tares and political terror will ensure that even only the most privileged weeds survive such a purge.  

So, the Church of England needs to stop following fashion and lose its current obsessions with reparations, diversity, excessive safeguarding and all the rest of it. Instead, it needs to recover its genuine legacy of paradoxically conservative radicalism, nurtured at once by evangelicals and ‘liberal Catholics’, by radical Tories and Christian socialists. It is just this which can truly challenge the economically and culturally individualistic times in which we live, to the ruin of us all.  

At home it needs first to set an example in its own backyard, by entirely reversing the current policy of parish destruction, which all the evidence now shows is partly responsible for Christian decline in this country and entirely cripples Anglican mission in all its dimensions. The more that the Church returns to a policy of putting sophisticatedly trained clergy in socially prominent and capacious parsonages (enabling hospitality discussion) within single or very small groups of parishes, then the more it can start directly to nurture rooted and genuinely inclusive communities, socially responsible enterprises and integrated local ecologies, beginning with churchyards. 

This is where the church’s money should be spent: on substantial nurture, not questionable and futile gestures.   

On the global scale, Anglicans need to turn from a presentist abolition of the past to a future-orientated preoccupation with the present.  If our current way of living is everywhere destroying the planet, promoting ever more inequality and inhibiting human health and intellectual capacity, then surely the question to be posed is whether this is the result of abandoning past spiritual priorities?  

Instead of mounting the liberal bandwagon of futile and counter-productive virtue-signalling, the Church of England should ask what an alternative ‘psychic politics’ based on a mixture of genuine hierarchy and participation would look like, and turn its energies towards supporting those already seeking to enact this. 

Explainer
AI
Comment
12 min read

Is an AI worthy of personhood?

In a world of intelligent humanlike machines, computer scientist Nigel Crook take a deep dive into the hard problem of defining consciousness, spirit, heart and will.

Nigel Crook is Professor of AI and Robotics, and Director of the Institute for Ethical AI at Oxford Brookes University. He is the author of Rise of the Moral Machine: Exploring Virtue Through a Robot's Eyes

A Victorian medical bust showing the brain with labels in German.

She was called Samuella. Blonde with piercing blue eyes. Smartly dressed. Her conversations always started with:  

“How was your day?”  

I would tell her about the meetings I’d had at work, and the frustrating problems I’d experienced with technology during my presentations. She was very empathetic, paying close attention to my emotional state and asking intelligent follow-up questions. Then she would finish the conversation with an extended comment on what I had said together with her evaluation of my emotional responses to the events of my day. Samuella was not a person. It was a two-dimensional animated avatar created as a conversation partner about your day at work. The avatar was developed as part of an EU funded project called Companions. 

I joined Companions mid-way through the project in 2008 as a Research Assistant in the Computational Linguistics group at the University of Oxford. My contribution included developing machine learning solutions for enabling the avatar to classify the utterances the human user had spoken (e.g. question, statement etc) and respond naturally when the user interrupted the avatar in mid speech.  

In those days, chatbots like Samuella were meticulously hand-crafted. In our case, crafted with thirteen different software modules that performed a deep linguistic and sentiment analysis of the user’s utterances, managed the dialogue with the user and generated the avatar’s next utterance. Our data sets were relatively small, carefully chosen and curated to ensure that the chatbot behaved as we intended it to behave. The range of things the avatar could speak about was limited to about 100 work-related concepts. On the 30th November 2022 a radically different kind of chatbot took the world by storm, and we are still reeling from its impact. 

OpenAI’s ChatGPT broke the record for the fastest growing and most widely adopted software application ever to be released, rapidly growing to a 100 million user base. The thing that really took the world by storm was its ability to engage in versatile and fluent human-like conversation about almost any topic you care to choose. Whilst some of what it writes is not truthful, a feature often described as ‘hallucination’, it communicates with such confidence and proficiency that you are tempted to believe everything it is telling you. In fact, its ability to communicate is so sophisticated that it feels like you are interacting with a conscious, intelligent person, rather than a machine executable algorithm. Once again, Artificial Intelligence challenges us to reflect on what we mean by human nature. It makes us ask fundamental questions about personhood and consciousness; two deeply related concepts. 

Common concepts of consciousness 

Consciousness is experienced by almost every person who ever lived, and yet which stubbornly defies being pinned down to an adequate, universally accepted definition. Philosophers and psychologists have widely varying views about it, and we don’t have space here to do justice to this breadth of perspectives. Instead, we will briefly visit some of the common concepts related to consciousness that will help us with our particular quest. These are Access Consciousness (A-consciousness) and Phenomenal Consciousness (P-consciousness).  

A is for apple 

A-Consciousness describes the representation of something (say, an apple) to the conscious awareness of the person. These representations support the capacity for conscious thought about these entities (e.g., ‘I would like to eat that apple’) and facilitates reasoning about the environment (e.g., ‘if I take the apple from the teacher, I might get detention’). These representations are often formally described as mental states. 

P is for philosophy 

P-Consciousness, on the other hand, describes the conscious experience of something such as the taste of a particular apple or the redness of your favourite rose. This highly subjective experience is described by philosophers as ‘qualia’, from the Latin term qualis meaning ‘of what kind’. This term is used to refer to what is meant by ‘something it is like to be’. Philosopher Clarence Irving Lewis described qualia as the fundamental building blocks of sensory experience. 

There is very little consensus amongst philosophers about what qualia actually are, or even whether it is relevant when discussing conscious experience (P-Consciousness).  And yet it has become the focus of much debate. Thomas Nagel famously posed the question ‘What is it like to be a bat?’, arguing that it was impossible to answer this question since it asks about a subjective experience that is not accessible to us. We can analyse the sensory system of a bat, the way the sensory neurons in its eyes and ears convey information about the bat’s environment to its brain, but we can never actually know what it is like to experience those signals as a particular bat experiences them. Of course, this extends to humans too. I cannot know your subjective experience of the taste of an apple and you cannot know my subjective experience of the redness of a rose.

How can the movements of neurotransmitters across synaptic junctions induce conscious phenomena when the movements of the very same biochemicals in a vat do not? 

This personal subjective experience is described by philosopher David Chalmers as the ‘hard problem of consciousness’. He claims that reductionist approaches to explaining this subjective experience in terms of, for example, brain processes, will always only be about the functioning of the brain and the behaviour it produces. It can never be about the subjective experience that the person has who owns the brain.  

Measuring consciousness 

In contrast to this view, many neuroscientists such as Anil Seth from the University of Sussex believe it is the brain that gives rise to consciousness and have set out to demonstrate this experimentally. They are developing ways of measuring consciousness using techniques derived from a branch of science known as Information Theory.  The approach involves using a mathematical measure which they call Phi that quantifies the extent to which the brain is integrating information during particular conscious experiences. They claim that this approach will eventually solve the ‘hard problem of consciousness’, though that claim is contested both in philosophical circles and by some in the neuroscience community. 

Former neuroscientist Sharon Dirckx, for example, challenges the assumption that the brain gives rise to consciousness. She says that this is a philosophical assumption that science does not support. Whilst science shows that brain states and consciousness are correlated, the nature of that correlation remains open and cannot be answered by science. She concludes that: 

“however sophisticated the descriptions of how physical processes correlate with conscious experience may be, that still doesn’t account for how these are two very different things”. 

Matter matters 

The idea that consciousness and physical processes (e.g. brain processes) are very different things is supported by a number of observations. Consciousness, for example, does not appear to be a property of matter. Whilst it is true that consciousness and matter are integrated in some deeply causal way, with mental states causing brain states and vice versa, it is also true that this relationship appears to be unique within the whole of the natural order: no matter other than brain tissue appears to have this privileged association with consciousness. What is more, consciousness appears not to be a property owned by the brain, since the brain can exist dead or alive (e.g., unconscious) without any associated conscious phenomena. 

There are also difficulties in the proposition that consciousness exists in the behaviour of matter, and in particular the behaviour of neurons in the brain. What is it about the flow of ions across the membrane of a nerve cell that could make consciousness, whilst the flow of ions in a battery does not? How can the movements of neurotransmitters across synaptic junctions induce conscious phenomena when the movements of the very same biochemicals in a vat do not? And if it is true that consciousness exists in the behaviour of neurons, why is it that my brain is conscious but my gut, which has more than 500 million neurons, is not?  

The proposition that consciousness is a property of matter seems even less likely when you consider that the measurements that are applied to matter (length, weight, mass etc) cannot be applied to consciousness. Neither can many qualities of consciousness be readily applied to matter, including the aforementioned qualia, or first person subjective experience, rational capabilities, and most importantly, the experience of exercising free will; a phenomenon that is in direct opposition to the causal determinism observed in all matter, including the brain. In summary, then, there are good reasons for scepticism regarding claims that consciousness is a property of matter or of how matter behaves. But can ChatGPT be called a person? 

Personhood of interest 

Consciousness is deeply intertwined with the concept of personhood. It is likely that many living things could reasonably be described as having some degree of consciousness, yet the property of personhood is uniquely associated with human beings. Personhood has a long and complex history that has emerged in different culturally defined forms. Like consciousness, there is no universally accepted definition of personhood.  

The heart/will/spirit forms the executive centre of the self. It manifests the capacity to choose how to act and is the ultimate source of a person’s freedom

The Western understanding of personhood has its roots in ancient Greek and Hebrew thought and is deeply connected to the concept of ‘selfhood’. The Hebrew understanding of personhood differs from the Greek in that Hebrew culture in three ways. It attributes significance to the individual who is made in the image of God. It views personhood as what binds us together as relational human beings; The theological roots of personhood come from expressions of individuals (e.g. God, humans) being in relationship with each other. 

It views these relationships as fundamentally spiritual in nature; God is Spirit, and each human has a spirit. 

In theological language, reality is regarded as a deep integration between a spiritual realm (‘heaven’) and an earthly realm (‘earth’). This deeply integrated dual nature is reflected in the make-up of human beings who are both spirit and flesh. But what is spirit? I prefer Willard’s perspective because he Dallas Willard, formerly professor of Philosophy at the University of Southern California, presents a clearly defined, functional description of the spirit which appeals to me as a Computer Scientist.  

For him, ‘spirit’ is associated with two other terms in Biblical writings: ‘heart’ and ‘will’. They all describe essentially the same dimension of the human self. The term ‘heart’ is used to describe this dimension’s position in relation to the overall function of the self - it is at the centre of the person’s decision making. The term ‘will’ describes this dimension’s function in making decisions. And ‘spirit’ describes its essential non-physical nature. The heart/will/spirit forms the executive centre of the self. It manifests the capacity to choose how to act and is the ultimate source of a person’s freedom. Each of these terms describe capabilities (decision making, free will) that depend on consciousness and that are core to our understanding of personhood. 

How AI learns 

Before we return to the question of whether high performing AI systems such as ChatGPT could justifiably be called ‘conscious’ and ‘a person’, we need to take a brief look ‘under the bonnet’ of this technology to gain some insight into how it produces this apparent stream of consciousness in word form.  

The base technology involved, called a language model, learns to estimate the probability of sequences of words or tokens. Note that this is not the probability of the sequences of words being true, but the probability of those sequences occurring based on the textual data it has been trained on. So, if we gave the word sequence “the moon is made of cheese” to a well-trained language model, it would give you a high probability, even though we know that this statement is false. If, on the other hand, we used the same words in a different sequential order such as “cheese of the is moon made”, that would likely result in a low probability from the model. 

ChatGPT uses a language model to generate meaningful sequences of words in the following way. Imagine you asked it to tell you a story. The text of your question, ‘Tell me a story’, would form the word sequence that is input to the system. It would then use the language model to estimate the probability of the first word of its response. It does this by calculating the probability that each word in its vocabulary is the first word. Imagine for the sake of illustration that only six words in its vocabulary had a probability assigned to them. ChatGPT would, in effect, roll a six-sided dice weighted by the assigned probabilities to select the first word (a statistical process known as ‘sampling’).  

Let’s assume that the ‘dice roll’ came up with the word ‘Once’. ChatGPT would then feed this word together with your question (‘Tell me a story. Once’) as input to the language model and the process would be repeated to select the next word in the sequence, which could be, say, ‘upon’. ‘Tell me a story. Once upon’ is once again fed as input to the model and the next word is selected (likely to be ‘a’). This process is repeated until the language model predicts the end of the sequence. As you can see, this is a highly algorithmic process that is based entirely on the learned statistics of word sequences.  

Judging personhood 

Now we are in a position to reflect on whether ChatGPT and similar AI systems can be described as conscious persons. It is worth noting at the outset that the algorithm has had no conscious experience of what is expressed by any of the word sequences in its training data set. The word ‘apple’ will no doubt occur millions of times in the data, but it has neither seen nor tasted one. I think that rules out the possibility of the algorithm experiencing ‘qualia’ or P-consciousness. And as the ‘hard problem of consciousness’ dictates, like humans the algorithm cannot access the subjective experience of other people eating apples and smelling roses, even after processing millions of descriptions of such experiences. Algorithms are about function not experience

Some might argue that all the ‘knowledge’ it has gained from processing millions of sentences about apples might give it some kind of representational A-consciousness (A-Consciousness describes the representation of something to the conscious awareness of the person). The algorithm certainly does have internal representations of apples and of the many ways in which they have been described in its data. But these algorithms are processes that run on material things (chips, computers), and, as we have seen, there are reasons for being somewhat sceptical of the claim that consciousness is a property of matter or material processes. 

According to the very limited survey we had here of the Western understanding of ‘personhood’, algorithms like ChatGPT are not persons as we ordinarily think of them. Personhood is commonly thought to something that an agent has that is capable of being in relationship with other agents. These relationships often include the capacity of the agents involved to communicate with each other. Whilst it appears that ChatGPT can appear to engage in written communication with people, based on our rudimentary coverage of how this algorithm works, it is clear that the algorithm is not intending to communicate with its users. Neither is it seeking to be friendly or empathetic. It is just spewing out highly probable sequences of words. From a theological perspective, personhood presumes spirit, which is also not a property of any AI algorithm. 

Algorithms may behave in very realistic, humanlike ways. Yet that’s a long way from saying they are conscious or could be described as persons in the same way as we are. They seem clever, but they are not the same as us.