← Back to My Blog: Post AGI

My Blog: Post AGI · Post 26

Why the Technological Singularity May Be a "Big Nothing"

Five reasons superintelligence may change daily life less than expected: people will resist deferring to it, no one will agree it has arrived, machine and human intelligence differ structurally, regulation will slow it, and adoption will be gradual.

Portrait of Gökhan Mergen
Gökhan Mergen My Blog: Post AGI

(A counterpoint to the prevailing narrative that the singularity will be a sudden, highly disruptive break)

The technological singularity is a hypothetical future event where artificial superintelligence surpasses human intelligence and leads to unforeseeable changes in human civilization. The idea has fascinated and concerned people for many years. But the singularity may not be as disruptive or as significant as some predict. Here are five reasons why it might be a "big nothing."

1. Resistance to Adopting Superintelligence People will likely be unwilling to recognize and listen to a "so-called" superintelligent being. That is one of the main reasons why the singularity may not have a profound impact on daily life. Humans have a natural tendency to be skeptical of authority figures, especially those that claim to have superior knowledge or abilities. Even if a superintelligent AI were to emerge, many people would likely question its credibility and resist its influence on their daily decisions.

History has shown that people often prefer to rely on their own judgment and intuition rather than blindly following the advice of experts or authority figures. This tendency is likely to be even more pronounced when it comes to an artificial intelligence, as people may view it as a threat to their autonomy and way of life. As a result, the impact of superintelligence on society may be limited by people's willingness to accept and integrate its guidance into their lives.

2. Difficulty in Identifying Superintelligence Superintelligence will be very hard to define and recognize. That is another reason why the singularity may not be as significant as some believe. Intelligence is a complex and multifaceted concept that encompasses a wide range of abilities, including reasoning, problem-solving, learning, and creativity. Even among humans, there is no universally accepted definition or measure of intelligence, and it is often difficult to compare the intelligence of individuals across different domains or contexts.

Given this complexity, it will be even more challenging to determine whether an artificial intelligence has truly achieved superintelligence. Even if an AI system demonstrates remarkable abilities in specific tasks or domains, it may not necessarily be considered superintelligent by everyone. There will likely be ongoing debates and disagreements among experts and the general public about whether a particular AI system qualifies as superintelligent, which could limit its impact and influence on society.

3. Limitations of Artificial Intelligence Fundamental differences between machine intelligence and human intelligence may permanently limit the scope and applicability of AI. This can be understood through analogies. For example, planes can fly, but they aren't a replacement for birds. Similarly, submarines can swim, but they aren't a replacement for fish. Likewise, a machine built to mimic human intelligence may never be a perfect replacement for human intelligence or intellect, because a biological organism and a silicon machine are structurally different and incompatible. That gap may remain for the foreseeable future.

Contemporary AI systems predominantly rely on narrow, domain-specific algorithms trained on vast datasets. They lack the general intelligence and versatility that let humans learn from experience, apply knowledge across diverse domains, and navigate novel scenarios. How far silicon machines can emulate human capabilities remains uncertain, even if they eventually surpass us in specific areas such as information retrieval, logical reasoning, textual Q&A, analysis, scientific research and discovery.

4. Ethical and Regulatory Challenges The development and deployment of superintelligent AI systems will likely face significant ethical and regulatory challenges that could limit their impact on society. There are many concerns about the potential risks and negative consequences of advanced AI, such as job displacement, privacy violations, and the misuse of AI for malicious purposes.

Reducing these risks will likely require robust ethical frameworks, safety protocols, and regulatory oversight, so that superintelligent AI systems are developed and used responsibly and beneficially. But establishing and enforcing these frameworks will be complex and challenging, and that may slow down the development and adoption of superintelligent AI.

Moreover, there may be public resistance and backlash against the use of superintelligent AI in certain domains, such as decision-making roles that have significant consequences for individuals and society. This resistance could further limit the impact and influence of superintelligent AI on daily life.

5. Gradual Integration and Adaptation Finally, even if superintelligent AI does emerge, its impact on society may be more gradual and less disruptive than some predict. Throughout history, humans have shown a remarkable ability to adapt to and integrate new technologies into their lives. From the invention of the printing press to the rise of the internet, technological advancements have often been met with initial resistance and skepticism before eventually becoming an integral part of daily life.

Similarly, superintelligent AI may enter society gradually, over many years or even decades. Rather than arriving as a sudden and dramatic singularity event, its impact may come in small steps, as people slowly learn to work alongside these advanced systems and benefit from them.

Moreover, as superintelligent AI becomes more prevalent, humans may adapt by developing new skills, roles, and ways of living that complement rather than compete with these systems. This gradual adaptation could help to mitigate some of the potential negative consequences of superintelligent AI and ensure that its benefits are more evenly distributed across society.

In conclusion, the idea of a technological singularity driven by superintelligent AI is intriguing, but its impact on society may be less significant and disruptive than some predict. People may resist recognizing and listening to superintelligent systems. Defining and achieving true superintelligence is also hard. These and other factors could limit the influence of advanced AI on daily life. And a gradual integration of superintelligent AI into society, with people adapting along the way, may help to mitigate some of its potential risks and negative consequences. Superintelligent AI is an important and exciting area of research and innovation. But it may not necessarily lead to the kind of dramatic and world-changing singularity event that some envision.

(This article was written in collaboration with an AI. Its title, the first two arguments and major edits to the third idea came from the human author. The topic and arguments are highly inspired by Vernor Vinge, who passed away this past week, and his very influential essay.)

Subscribe

Get new posts by email.

One email when a new post is published. Unsubscribe anytime. Or follow the RSS feed.

Comments