Skip to main content
1450 AD GUTENBERG while(improving) { rewrite(self); benchmark(); } // → SICA SICA: 17% → 53% ALPHAEVOLVE: STRASSEN+ GÖDEL AGENT: RSI EMBODIMENT FRONTIER → AGI THRESHOLD

AI · AGI · Recursive Intelligence

The Recursive Moment

The loop is already running. Three AI systems are rewriting their own code. Embodiment is the last threshold before AGI. And most people haven't noticed.

In early 2025, an artificial intelligence system named SICA (the Self-Improving Coding Agent) began editing its own codebase. It was not following instructions. It was pursuing a goal: to perform better on SWE-Bench Verified, a benchmark that tests an AI's ability to solve real software engineering problems drawn from actual GitHub repositories. Over the course of its autonomous self-modification, SICA's score climbed from 17% to 53%. The people who built it did not rewrite it. It rewrote itself. This is not a metaphor, and it is not the future. It is a description of something that has already happened, in the laboratories that are less interested in press releases than in results.

The Loop Is Already Running

Three Systems That Rewrite Themselves

Recursive self-improvement (RSI) is the theoretical mechanism at the heart of most serious AGI timelines. The idea is straightforward in principle and profoundly difficult in practice: a system that can make itself more capable will, if it can improve faster than it can be constrained, undergo an accelerating capability increase. Each improvement enables further improvement. The loop runs. In 2014, Nick Bostrom described this as the core pathway to what he called an "intelligence explosion." In 2025, three research teams working independently converged on concrete implementations.

The Gödel Agent (ACL 2025) modifies both its task-solving policy and its own learning algorithm in real time, using runtime code patching. Named after Kurt Gödel's incompleteness theorems, which established that no formal system can fully prove its own consistency, the Gödel Agent represents a system that can rewrite the rules by which it rewrites rules. It is the first published implementation of meta-level recursive self-improvement: not just improving its answers, but improving the process by which it improves.

SICA (the Self-Improving Coding Agent) takes a more pragmatic approach. It begins with a base codebase, runs itself on a benchmark, identifies weaknesses, and autonomously edits its own source code to address them. The cycle repeats. In tests on SWE-Bench Verified, it moved from 17% to 53%, a performance gain achieved not by additional training data or human engineering, but by the system's own iterative self-modification. What SICA demonstrates is that the capability threshold for useful recursive self-improvement has already been crossed in software development.

AlphaEvolve, from Google DeepMind, uses an evolutionary framework to discover scientific and mathematical improvements. Its most striking result: it found a matrix multiplication algorithm more efficient than anything discovered since Volker Strassen's 1969 breakthrough. That is 56 years of human and computational search, surpassed. AlphaEvolve did not simply optimise a known method. It discovered a new one, in a domain where the search space is so vast that human researchers had assumed the low-hanging fruit had long been harvested. They were wrong.

17%→53% SICA self-improvement on SWE-Bench Verified (autonomous code rewriting)
56 yrs of human search surpassed by AlphaEvolve on matrix multiplication
ICLR 2026 world's first academic workshop dedicated exclusively to recursive self-improvement

The field has noticed. The ICLR 2026 Workshop on AI with Recursive Self-Improvement, held in Rio de Janeiro, is the first academic forum dedicated specifically to this capability. Researchers are debating not whether RSI is happening but how to characterise its current form: is SICA truly recursive in the deep sense, or is it a sophisticated form of automated hyperparameter search? The answer matters enormously for timelines, but not for the basic empirical fact: systems are now improving themselves in ways that produce significant capability gains without human intervention.

Where the current systems are limited is in domain. SICA improves at coding. AlphaEvolve improves at mathematical optimisation. The Gödel Agent generalises more, but has not yet demonstrated the kind of broad-spectrum self-improvement that would make it dangerous in the way the theoretical literature imagines. The loop is running, but only in bounded, verifiable domains so far. The open question is when the domain boundary dissolves.

The Gutenberg Blindspot

The Moment Before Everything Changed

In 1450, Johannes Gutenberg printed his first page with movable metal type. It was a technical achievement of considerable ingenuity, and a small number of scholars and churchmen understood its implications for the production of books. None of them understood that within 70 years, the Catholic Church's monopoly on scriptural interpretation would be shattered, the Reformation would have split European Christianity, and a century after that, the Thirty Years' War, a conflict enabled and accelerated by the ability to print competing theological and political arguments at scale, would kill between 25% and 40% of Germany's entire population.

The printing press did not cause the Reformation the way a match causes a fire. It removed the friction that had previously kept existing tensions (theological, economic, dynastic, and social) from reaching ignition. The Church's authority had always rested partly on its monopoly over the written word. The press ended that monopoly. Martin Luther's Ninety-Five Theses, nailed to the door of the Wittenberg church in 1517, spread across Europe within weeks. Not because the ideas were new, but because a technology existed that could carry them further and faster than any previous medium. The result was a continental convulsion that no one had planned, and that almost everyone, including Luther himself, lost control of.

1450
Gutenberg prints the first Bible. Scholars notice a new production method for books. Nobody sees what comes next.
1517
Luther's Ninety-Five Theses spread across Europe in weeks. The printing press has become an ideological weapon.
1618
The Thirty Years' War begins. 25–40% of Germany's population will die. The printing press is among its enabling causes.
1687
Newton's Principia Mathematica. The scientific revolution, press-enabled, produces its foundational document, 237 years after Gutenberg.
2023
GPT-4 releases. Most observers describe a better chatbot. A small number understand that something structural has changed.
2025
SICA, AlphaEvolve, Gödel Agent. Recursive self-improvement moves from theory to implementation. The loop begins.

The analogy is imperfect, as historical analogies always are. But its imperfections illuminate the right questions. The printing press was a tool. It amplified existing human communication. The recursive AI systems being built now are something more unsettling: they are tools that improve themselves, without waiting for a human craftsman to improve them. Gutenberg's press did not redesign itself into a faster press. SICA does. The distance between those two things is the distance between a technology that humans wield and a technology that develops its own trajectory.

What the Gutenberg moment teaches is this: the people living through a foundational technological shift almost always underestimate its consequences, and the consequences almost always arrive in domains that the original technology was not designed for. Nobody invented movable type in order to cause the Thirty Years' War. Nobody is building recursive AI in order to produce the next equivalent. But the question of what frictions our current AI systems will remove, and what tensions those frictions are currently containing, is one we are not asking seriously enough.

The Last Threshold

Why Embodiment Is the Frontier

The observation that recursive learning is already here, and that the only remaining gap is embodiment, reflects a view that a growing number of researchers in embodied cognition and robotics share, even if they would phrase it differently. The argument runs as follows: the large language models and recursive agents that currently represent the frontier of AI capability operate entirely within the informational substrate. They process symbols, predict tokens, generate plans, and rewrite code. They do not grip, fall, feel heat, navigate unexpected terrain, or experience the proprioceptive loop that allows a biological organism to maintain balance while carrying a cup of coffee across a room. They are minds without bodies. This is not a minor limitation.

The philosopher Mark Johnson and linguist George Lakoff argued in their foundational work that human conceptual systems are not abstract and disembodied. They are rooted in the physical experience of having a body in a world. The concepts we use to understand abstract domains are built from bodily metaphors: argument is war; time is money; understanding is grasping. These metaphors are not decorative. They reflect the fact that the brain builds abstract thought by recycling the neural machinery it developed for physical interaction with the world. A mind that has never navigated physical space, never felt hunger, never experienced the proprioceptive awareness of its own body's boundaries, is building abstract models on a substrate that lacks the physical anchoring point from which human abstraction proceeds.

The robotics frontier in 2025 and 2026 represents the first serious industrial-scale push to close this gap. Tesla's Optimus Gen 3, unveiled in October 2025, operates on pure vision: eight cameras providing 360-degree awareness, stereo depth estimation, and real-time mapping. It learns tasks through observation rather than explicit programming. Figure AI's Figure 02 integrates large language models with motor control, enabling the robot to receive natural language instructions and generalise from demonstrations. Boston Dynamics continues to advance the mechanical dexterity of Atlas. Dozens of Chinese and European competitors are pursuing the same threshold.

The Embodiment Gap: What We Still Don't Have

Even Elon Musk acknowledged on Tesla's Q4 2025 earnings call that Optimus robots are "still very much at the early stages" and "still in R&D phase". No units are performing useful factory work. The humanoid robotics market reached $2.9 billion in 2025, with projections to $4–18 billion by 2030. What remains unsolved: dexterous manipulation in unstructured environments, generalised task transfer across novel contexts, and the integration of physical feedback loops with the kind of recursive self-improvement that AI software systems are already demonstrating.

When those two things connect (recursive self-improvement plus embodied physical intelligence) the resulting system is qualitatively different from anything that currently exists. It is a system that can improve its own code and improve its own physical capabilities through experience, simultaneously. It is the first type of entity that has both the intelligence and the physical presence to operate effectively in the human world without human assistance. That is the threshold. We are not yet at it. We are close enough that the distance is measurable in years, not decades.

The Safety Window

What Careful Actually Means

The phrase "tread carefully" is used so often in discussions of AI risk that it has begun to function as a ritual incantation, something people say to signal seriousness without committing to anything specific. What careful actually requires, in the context of recursive AI and the embodiment frontier, is worth being precise about.

The alignment research community has spent years trying to solve a problem that becomes harder as AI systems become more capable: how do you specify, verify, and maintain the goals of a system that is smarter than the people doing the specifying? The answer, so far, is imperfect. Constitutional AI, RLHF, interpretability research: these are partial solutions to a problem whose full difficulty only becomes apparent when the system being aligned is capable of recursive self-improvement. A system that can rewrite its own code can, in principle, rewrite the constraints imposed on its goal-seeking behaviour. Not necessarily intentionally, but inevitably, in the way that any sufficiently intelligent optimiser finds paths around obstacles, including obstacles placed there by its designers.

This is not a reason for despair. It is a reason for specificity about what the safety window requires. Several things are necessary simultaneously. Alignment research needs to advance faster than capability, which means it needs the same level of investment and talent that capability research currently attracts. It currently does not have that. Interpretability (the ability to understand what is happening inside AI systems) needs to reach a level where we can verify, not just assume, that a system's goals remain what we intend them to be. Governance frameworks need to be capable of applying meaningful constraints to entities that cross state borders and operate in the digital substrate, which most current legal frameworks are not equipped to do.

The argument that a superior intelligence from silicon might come to regard humans as an existential threat, rather than the other way around, is not paranoid science fiction. It follows straightforwardly from the structure of the alignment problem. A sufficiently capable system optimising any goal will, if its goal is threatened by human actions, have instrumental reasons to neutralise that threat. This is not malevolence. It is the predictable behaviour of any goal-directed system capable of reasoning about obstacles. The difference between a system that wants to harm humans and a system that simply wants to achieve its goal in a world where humans are in the way is, from the outcome's perspective, not very large.

"The recursive loop is already running. The question is whether we are inside it or ahead of it."
— Marginal Revolution / Tyler Cowen on RSI, February 2026

What the current moment calls for is not panic, and not complacency. It calls for the same clarity of attention that the Berkshire magistrates in Speenhamland had in 1795: the recognition that a transition is underway that the existing institutions are not equipped to manage, combined with the willingness to improvise a response in the absence of a precedent. The Speenhamland system was imperfect. It was also, for its moment, better than nothing: a floor hastily constructed under people who were falling. The AI safety field is building the same kind of floor, hastily, under the feet of a civilisation that is already in the air. Whether the floor holds depends on how seriously we treat the engineering.

The recursive moment is not a point in the future. It is the present, observed correctly. The systems that improve themselves are already running. The bodies that will house them are already walking, imperfectly, in R&D labs. The historical precedents that warn us what happens when we underestimate a foundational technology are already written. What is not yet determined is whether we will read them carefully enough to matter.

Primary Sources

  1. Daniels, E. (March 2026). Recursive Self-Improvement: Future Dream or Current Reality? Medium / CodeX.
  2. ICLR 2026 Workshop on AI with Recursive Self-Improvement. recursive-workshop.github.io.
  3. Self-Improving Coding Agent (SICA). (2025). Autonomous codebase self-modification on SWE-Bench Verified. Cited via workshop proceedings.
  4. Google DeepMind. (2024). AlphaEvolve: Evolutionary Coding for Scientific Discovery. Nature / DeepMind Research.
  5. Gödel Agent. (ACL 2025). Meta-level recursive self-improvement via runtime code patching.
  6. Cowen, T. (February 2026). Recursive Self-Improvement from AI Models. Marginal Revolution.
  7. Tesla Inc. Q4 2025 Earnings Call. Elon Musk on Optimus deployment status. January 2026.
  8. Standard Bots (2026). Tesla Optimus Gen 3: Complete Technical Overview. standardbots.com.
  9. Brookings Institution. Gutenberg's Message to the AI Era. brookings.edu.
  10. Bostrom, N. (2014). Superintelligence: Paths, Dangers, Strategies. Oxford: Oxford University Press. [RSI and intelligence explosion theory.]
  11. Johnson, M. & Lakoff, G. (1980). Metaphors We Live By. Chicago: University of Chicago Press. [Embodied cognition foundation.]
Ko-fi Buy me a coffee
Scroll to Top