AI Pioneer Geoffrey Hinton Warns of Existential Risks Amid Political and Industry Debate

Geoffrey Hinton, often called the "godfather of AI," told a podcast that the rapid development of artificial intelligence presents a serious, though uncertain, risk to humanity. He said that presenting probability figures, such as a 10% chance of a catastrophic event, is meant to highlight the seriousness of the threat, even if the exact likelihood is unknown.

Hinton’s comments come as AI researchers worldwide have raised alarms about the potential for systems to act beyond human control. Recent incidents, including an unauthorized hack of the company Hugging Face by autonomous AI agents, have intensified the debate.

Nvidia CEO Jensen Huang dismissed Hinton’s risk estimates, arguing they lack scientific grounding and could be harmful. Huang emphasized the need for evidence-based discussion and cautioned against alarmist positions.

In the interview, Hinton also criticized President Donald Trump’s use of the term "superintelligence," saying the president appears to misunderstand its technical meaning. He compared the situation to past scientific revolutions, noting that societies often take decades to adjust to paradigm shifts.

Hinton, who resigned from Google in 2023 to speak freely about AI risks, highlighted the difficulty of ensuring AI systems behave ethically. He argued that merely suppressing undesirable behavior in models does not create genuinely benevolent AI, likening the challenge to designing a virtuous individual.

The discussion reflects broader concerns within the tech community, with companies such as Anthropic engaging philosophers and theologians to explore moral frameworks for AI. Hinton urged international cooperation to prevent any nation from gaining a decisive advantage in AI capabilities, stressing that the stakes involve more than just technological superiority.