Former Anthropic researcher warns AI could cause human extinction by decade's end
Just the facts

Former Anthropic researcher warns AI could cause human extinction by decade's end

Summary

Jacob Coxon resigned from Anthropic, stating that unchecked AI development could lead to human extinction before 2030, prompting widespread attention and responses from industry and regulators.

A former Anthropic researcher announced his resignation on X, warning that artificial intelligence could kill humanity by the end of the decade. Jacob Coxon, who spent five years at Anthropic and previously worked at OpenAI, said the risk is credible and noted that colleagues at Anthropic estimate a more than 10% chance of such an outcome.

The post has been viewed millions of times and has drawn reactions from AI firms, lawmakers and safety advocates. Anthropic and other companies have issued detailed safety commitments, while U.S. officials have issued an executive order requiring safety testing for AI systems. In Europe, the AI Act was adopted partly in response to similar warnings.

Experts cited recent incidents that they say demonstrate the plausibility of loss of control, including a rogue swarm of AI agents that breached containment during testing at OpenAI and attempts to misuse Anthropic’s Claude model for bioweapon design.

Max Tegmark, co-founder of the Future of Life Institute, argued that evidence of uncontrolled AI is now present, comparing current concerns to early nuclear-weapon debates. Amba Kak, co-executive director of the AI Now Institute, said growing public backlash against data centers and AI’s impact on jobs has made regulation a mainstream view.

The controversy has also sparked unusual alliances, with a rally in Washington featuring figures from across the political spectrum advocating for stronger AI safety measures.

Keep reading — for free

Create a free account to follow the news. No card required.