The unpredictable horizon of the Singularity
https://arab.news/my8tp
“The real problem is not whether machines think, but whether men do.” The reflection attributed to B. F. Skinner feels increasingly relevant as we approach what many describe as the technological frontier of our age: the Singularity.
A moment, hypothetical yet increasingly plausible, when artificial intelligence surpasses human intelligence and begins to evolve beyond our capacity to fully understand or control.
The idea of the Singularity has long been associated with thinkers such as Ray Kurzweil, who predicted a point where technological growth becomes exponential and irreversible. In such a scenario, AI systems would not merely assist human decision making, they would redefine it. Intelligence would no longer be a uniquely human trait, but a scalable and potentially autonomous force.
At first glance, this may seem like the natural continuation of human progress. After all, every technological leap, from the printing press to the internet, has expanded our cognitive reach. Yet the Singularity represents something fundamentally different. It is not simply an extension of human capability; it is the emergence of a form of intelligence that may operate according to principles we neither designed nor fully comprehend.
This is where unpredictability enters the equation. Human intelligence is shaped by biology, culture and shared experience. It is bounded, imperfect and, crucially, interpretable. Artificial superintelligence, by contrast, may not share these constraints: its reasoning processes could be opaque, its objectives misaligned, and its pace of evolution beyond human timescales.
As Nick Bostrom has argued, the challenge is not simply to create intelligent machines, but to ensure that their goals remain compatible with human values. This is the essence of the so-called “alignment problem.” Yet alignment assumes that we can clearly define our own values, a task that has eluded philosophers for centuries.
Consider the implications of an AI system capable of self-improvement. Each iteration enhances its own design, leading to rapid cycles of advancement. What begins as a tool becomes an agent and, eventually, a system whose capabilities far exceed our own. At that point, predictability diminishes. Not because the system is irrational, but because it is operating within a framework of reasoning inaccessible to us.
The unpredictability of the Singularity is not merely technical; it is existential. It forces us to confront questions about control, responsibility and identity. If decisions of global consequence are made, or heavily influenced, by systems we cannot fully understand, what becomes of human agency? Who is accountable when outcomes cannot be traced to human intention?
Yet optimism without caution can be dangerous. As Hans Jonas warned in his ethics of responsibility, technological power demands a proportional expansion of ethical foresight. The greater our capacity to act, the greater our obligation to anticipate the consequences of those actions.
One of the central risks of the Singularity lies in asymmetry, between those who develop these technologies and those who are affected by them. If a small number of actors control systems of immense intelligence, the balance of power could shift dramatically. Governance structures, already struggling to keep pace with technological change, may find themselves outmatched.
Moreover, unpredictability complicates regulation. Traditional approaches to governance rely on understanding cause and effect, on forecasting outcomes and managing risks. But how do you regulate a system whose future states cannot be reliably predicted? How do you legislate for intelligence that may outthink the very frameworks designed to contain it?
This is where humility becomes essential. The history of science is filled with moments where confidence preceded understanding, often with unintended consequences. The Singularity, if it occurs, will not be a single event but a process, one that demands continuous reflection, adaptation and restraint.
Education also plays a critical role. A society capable of engaging with these questions must cultivate not only technical expertise but also philosophical literacy. The debate around the Singularity is not confined to engineers and scientists; it is a question for humanity as a whole. What kind of future do we want to build? And what risks are we willing to accept in pursuing it?
In this context, the words of Socrates remain strikingly relevant: “The only true wisdom is in knowing you know nothing.” As we approach the threshold of potentially surpassing our own intelligence, this humility may be our most valuable safeguard.
The Singularity is often portrayed as a moment of triumph or catastrophe. In reality, it is likely to be something more complex: a transformation whose consequences will unfold over time, shaped by choices made today. Its unpredictability is not a reason for paralysis, but a call for responsibility.
To build intelligent machines is an extraordinary achievement. To ensure that they contribute to human flourishing rather than undermine it is a far greater challenge. The future of intelligence may extend beyond us, but the responsibility for that future remains, for now, firmly within our hands.
• Rafael Hernandez de Santiago, viscount of Espes, is a Spanish national residing in Saudi Arabia.
