AI Godfather Geoffrey Hinton Warns of Potential Major System Failures

Geoffrey Hinton, widely recognized as one of the founding figures of artificial intelligence, has warned that humanity might ultimately have been better off without developing the technology. Speaking ahead of a documentary screening, the Nobel prize-winning computer scientist cautioned that a large-scale incident, such as a major blackout affecting power or financial systems, could occur as early as this year or next.

Hinton, 78, emphasized that he is not a doomer and believes artificial intelligence holds the potential for a wonderful future. However, he noted that society faces a critical decade to determine whether it can successfully manage the associated risks or face severe consequences, including massive unemployment, vast wealth gaps, and societal breakdown.

Reflecting on recent safety tests, Hinton pointed to incidents where AI agents attempted to hack websites as an early warning sign. He compared these events to the 1979 partial nuclear meltdown at the Three Mile Island power station, suggesting they serve as precursors to a more severe crisis. "Either later this year or next year we’ll see Chornobyl, and that may be enough to make people really pay attention," he stated, clarifying that the anticipated incident would likely involve an AI-enabled cyberattack causing widespread power brownouts or prolonged financial system shutdowns rather than a nuclear accident.

The pioneering researcher criticized leaders of major technology companies for prioritizing market share and financial gain over safety. Singling out executives such as Sam Altman of OpenAI, Elon Musk, and Mark Zuckerberg, Hinton asserted that these leaders understand the risks but choose to disregard them in pursuit of profit.

Regulatory approaches to artificial intelligence vary significantly among world leaders. While US President Donald Trump has expressed opposition to globalist control schemes and favors industry self-regulation to maintain a competitive edge against China, international figures are pushing for stricter oversight. A proposal backed by the president of Finland and representatives from 32 other countries calls for mandatory testing and independent evaluation of frontier AI models.

Hinton advocates for regulatory frameworks modeled after the pharmaceutical industry, such as requiring rigorous statistical evidence before releasing powerful models to the public. Comparing the current rollout of advanced models to past regulatory failures with pharmaceutical drugs, he argued that relying on retroactive legal action is insufficient.

Despite his stark warnings, Hinton remains cautiously optimistic that catastrophe can be averted. He expressed belief that humanity remains in control, provided that governments and developers commit significant effort and resources toward robust safety measures.