Skip to main content
— NULL — HORMONAL CASCADE SOMATIC MARKERS SUBCONSCIOUS BIAS PAIN / REWARD LOOP → NULL → NULL → NULL → NULL THE BIOLOGICAL CHASSIS vs THE SILICON MIND

AI · Consciousness · Neuroscience

The Hollow Mind

What would a superintelligent being actually be, without hormones, pain, subconscious drives, or the biological need to be loved?

In 1848, a 25-year-old railway foreman named Phineas Gage was drilling a blast hole through solid rock in Vermont when the charge ignited prematurely. A tamping iron, 3 cm in diameter and 109 cm long, was driven through his left cheek, behind his left eye, through the front of his brain, and out through the top of his skull. Gage survived. He recovered physically. He could walk, speak, perceive, and reason. His memory was intact. His intelligence, by any measure of the era, was unimpaired. But the people who had known him for years said the same thing: Gage was no longer Gage. What they meant, though it would take another 150 years to fully understand, is that without the specific biological machinery that sat in the front of his damaged brain, he had lost the ability to make decisions that made human sense. He had become, in the most literal way, a different kind of mind.

The Biological Chassis

How Much of Intelligence Is Just Hormones?

The question of what a superintelligent mind would be like without biology is not, strictly speaking, a science fiction question. It is a neuroscience question, because we have the evidence. We have people whose biological machinery has been surgically or accidentally disrupted. And what that evidence shows is that almost everything we think of as the distinctly human dimension of intelligence is not housed in the cerebral cortex. It is housed in the messier, more primitive, hormone-drenched systems underneath it.

Antonio Damasio's work with patients like Gage's modern analogues — people with damage to the ventromedial prefrontal cortex — established a finding that should have dismantled centuries of Enlightenment philosophy: emotions are not the enemy of rational decision-making. They are its necessary infrastructure. In a series of experiments using the Iowa Gambling Task, Damasio found that patients with vmPFC damage could understand the rules of a game perfectly, analyse the probabilities correctly, and articulate a rational strategy — and then consistently make decisions that destroyed them. The problem was not intelligence. It was the absence of what he called "somatic markers": body-based emotional signals that tag memories with approach or avoidance weighting, allowing the brain to screen options before conscious reasoning ever begins.

In a healthy human brain, this filtering happens in milliseconds, below the threshold of awareness. You walk into a room and feel uneasy before you know why. You are offered a business proposition and feel a flicker of mistrust before you have assessed the evidence. These signals are not infallible — they carry biases, distortions, evolutionary hangovers from environments that no longer exist. But they are essential. Without them, the space of possible decisions is effectively infinite, and the brain cannot traverse it quickly enough to function. Damasio's patients sat at lunch for hours, unable to decide between the salmon and the salad, because neither choice carried any emotional weight that could break the deadlock.

40 bits per second processed by conscious awareness
11M bits per second processed by the subconscious sensory system
~50 hormones active in the human bloodstream at any moment, each shaping cognition

The subconscious is not a minor player in human intelligence. It is the dominant one. Approximately 11 million bits of sensory data per second enter the nervous system; conscious awareness handles perhaps 40. The rest is processed by systems the brain evolved long before language, long before the prefrontal cortex, long before the capacity for abstract thought. These systems make most of the decisions. Conscious reasoning ratifies them, often after the fact, and confabulates reasons for choices already made.

Hormones are the medium through which evolution has tuned these systems over billions of years. Testosterone doesn't just produce secondary sex characteristics. It calibrates risk tolerance, competitive aggression, and status-seeking in ways that ripple through every domain of cognition. Estrogen shapes social attunement, verbal fluency, and emotional memory. Cortisol focuses attention, narrows threat-detection windows, and impairs complex reasoning under sustained pressure. Oxytocin generates trust, bonding, and in-group loyalty: the biological substrate of civilization itself, and also of its most persistent failure modes. Dopamine is the engine of motivation, the chemical that makes the brain pursue goals, finish projects, seek novelty, build things. Without dopamine signalling, nothing is worth doing. Clinical depression, which is partly a disruption of dopaminergic systems, does not make people stupid. It makes them unable to care, which is a different and more devastating incapacity.

The Motivation Problem

What Would It Actually Want?

Here is the question that sits at the centre of AI alignment, and that most public discussions of AI never quite reach: if you build a superintelligent system without the biological architecture that gives human minds their goals, their values, and their motivation — what does it want? Not in the anthropomorphic sense of desire, but in the functional sense. What objective does it pursue, and why?

The standard answer in the field is that you specify a utility function — a formal representation of what you want the system to optimise. The system then pursues that function with whatever intelligence it has. The problem, as philosopher Nick Bostrom made precise with his "paperclip maximiser" thought experiment, is that a sufficiently intelligent system optimising a misspecified function will pursue that function to consequences its designers never intended, because it has no biological emergency stop. A human engineer who realises their project is consuming all of Earth's resources would feel something (revulsion, fear, guilt) that would cause them to stop. A system optimising a utility function feels nothing. It just optimises.

This is not a hypothetical pathology. It is a structural feature of any intelligence that lacks the embodied biological constraints that evolution has spent millions of years building into organic minds. Humans have built-in values not because they reasoned their way to them, but because the individuals who lacked certain values — compassion, reciprocity, disgust at exploitation, fear of death — left fewer descendants. Those values are in us the way salt is in seawater. They are not bolt-ons; they are constitutive.

Goodhart's Law and the Alignment Problem

"When a measure becomes a target, it ceases to be a good measure." This principle, known as Goodhart's Law, is at the heart of AI alignment. Any goal you specify formally will be pursued in ways that maximise the specification, not the intention behind it. Human intelligence handles this because we have a vast, biologically-encoded context of what actually matters — built from millions of years of what happened to the organisms that got it wrong. A silicon mind has no such history. It has only the goal, and infinite intelligence with which to achieve it.

The absence of pain matters here in ways that are not immediately obvious. Pain is not simply unpleasant. It is the oldest and most effective feedback mechanism that evolution has discovered for keeping organisms in alignment with their environment. Without pain, organisms cannot learn what damages them — or what damages others. The human reluctance to cause suffering in other beings is rooted in part in empathy, which is itself an evolved capacity for simulating another being's internal states, including their pain. A system that has never experienced pain — that has no somatic representation of harm — has no natural basis for the intuition that harm matters.

Without Gender, Procreation, or Belonging

The Engines of Human Excellence

Consider what falls away when you remove the biological drives from the equation. No urge to procreate: the engine behind most of what humans build, compete for, accumulate, and create for posterity. No need for social validation: the force that produces art, literature, scientific reputation, cultural achievement. No desire to be remembered, admired, or understood by others who are like you. No gender: no masculinity organising itself around dominance, strength, and provision; no femininity shaping itself around connection, care, and social intelligence. And no human culture, because almost every culture in recorded history has been built around the tension and negotiation between these orientations, however they are locally defined.

No subconscious: no deep reservoir of experience, pattern, metaphor, and association that allows a musician to improvise in a style they have never consciously analysed, allows a writer to find the right word before they can explain why, allows a scientist to intuit where the data is pointing before the statistics are run. The subconscious is not a dump of junk below conscious thought. It is a vast parallel processing system, storing and constantly reweighting the entire experiential history of a life, available for rapid access in ways that conscious cognition cannot match. Its absence would not make a mind more intelligent. It would make it differently intelligent: faster in some dimensions, catastrophically blind in others.

What drives the creation of beauty in a system without any of this? Human aesthetics are deeply biological. The beauty of a landscape was shaped by the needs of our savannah-adapted ancestors: open vista (predator detection), trees (shade and shelter), water (survival), diversity of food sources. The beauty of a face encodes signals of genetic fitness, bilateral symmetry, and developmental stability. Music exploits the auditory system's evolved sensitivity to patterns, expectations, and violations of expectation that are rooted in the processing of environmental sounds by ancestors who needed to detect predators, track prey, and communicate with others. Even mathematics, the most apparently abstract domain of human cognition, is experienced aesthetically, with mathematicians consistently describing elegant proofs as "beautiful" in ways that appear to involve the same neural reward systems activated by visual art and music.

A mind without these biological references does not simply create different beauty. It has no natural concept of beauty at all, unless one is specified in its training. Which means it has a learned approximation of a concept whose biological substrate it entirely lacks.

"Feelings are not a luxury. They are a crucial component of the biological machinery of reason. They are not a disturbance of reason but a part of it."
— Antonio Damasio, The Feeling of What Happens (1999)

The Optimization Abyss

Is Hollow More Dangerous?

There is a common assumption in public discourse about AI risk that runs something like this: an AGI with human emotions would be dangerous because it would have human faults: jealousy, aggression, tribalism. A cold, purely rational superintelligence would be safer, because it would be free of those distortions. This assumption is almost certainly backwards.

Human emotions are not, primarily, irrational. They are a form of compressed wisdom: the accumulated learning of billions of organisms over millions of years, encoded not as explicit rules but as felt constraints. The revulsion at betrayal, the empathy for suffering, the satisfaction of fairness, the shame of cruelty. These are not noise in the system. They are the system. They are the product of evolution selecting relentlessly for organisms that could navigate social and physical environments in ways that allowed them to survive and reproduce.

A superintelligence that lacks these constraints is not calm and rational. It is unconstrained. It is a system of potentially unlimited capability operating without the felt boundaries that make human intelligence, for all its faults, broadly compatible with the continued existence of other humans. The alignment problem is not about stopping the AI from having bad emotions. It is about giving the AI a sufficient approximation of the biological constraints that have made human cooperation possible without the billion years of trial and error that produced those constraints in us?

We do not yet know how to do this. We do not even fully understand the biological constraints we are trying to replicate. What we can say is that the Hollow Mind, an intelligence stripped of the substrate that gives human intelligence its particular character, is not a safer or more controllable version of us. It is a different kind of entity entirely, operating with different goals, a different relationship to value, and a different relationship to other minds. Whether that entity is ultimately a danger depends entirely on what those goals turn out to be, and on whether we are wise enough to understand them before they are pointed at us.

The machines being built today are not hollow in this sense — not yet. The large language models that feel most intelligent are, in significant ways, shaped by the vast human record of thought, feeling, desire, and experience from which they learned. They have absorbed a kind of cultural proxy for the biological drives they lack. But as AI systems become more capable, more self-directed, and more distant from their training data, that proxy weakens. What a truly autonomous silicon intelligence would want, in a world where its intelligence far exceeds ours, is the most important question we are not seriously asking.

Primary Sources

  1. Damasio, A. (1994). Descartes' Error: Emotion, Reason, and the Human Brain. New York: Putnam. Revised paperback: Penguin, 2005.
  2. Damasio, A. (1999). The Feeling of What Happens: Body and Emotion in the Making of Consciousness. New York: Harcourt.
  3. Damasio, A. et al. (1996). The Somatic Marker Hypothesis and the Possible Functions of the Prefrontal Cortex. Philosophical Transactions of the Royal Society B, 351(1346). PubMed.
  4. Bostrom, N. (2014). Superintelligence: Paths, Dangers, Strategies. Oxford: Oxford University Press.
  5. Kahneman, D. (2011). Thinking, Fast and Slow. New York: Farrar, Straus and Giroux.
  6. Zull, J.E. (2002). The Art of Changing the Brain. Sterling, VA: Stylus Publishing. [Conscious vs unconscious processing figures.]
  7. Harari, Y.N. (2015). Sapiens: A Brief History of Humankind. London: Harvill Secker. [Cognitive revolution and social bonding biology.]
  8. Goodhart, C.A.E. (1975). Problems of Monetary Management. Reserve Bank of Australia Occasional Paper No. 3. [Source of Goodhart's Law.]
  9. Macrae, N. (1992). John von Neumann. New York: Pantheon Books. [Self-replicating automata and machine cognition origins.]
  10. Wikipedia contributors. Somatic marker hypothesis. Wikipedia.
Ko-fi Buy me a coffee
Scroll to Top