Anthropic researcher resigns, cites existential AI risk
सिर्फ तथ्य

Anthropic researcher resigns, cites existential AI risk

सारांश

Jacob Coxon left Anthropic, warning that unchecked AI development could pose a significant threat to humanity within the decade, a view echoed by colleagues.

Jacob Coxon, who has worked on pre-training research at Anthropic and OpenAI, announced his departure from Anthropic on X, stating that both companies are not acting responsibly in the race toward advanced artificial intelligence. He warned that the technology could become capable of self-improvement and pose severe risks to humanity if development continues unchecked.

Coxon said Anthropic understands the stakes but feels pressured to outpace competitors, adding that the firm lacks a clear plan to align superintelligent systems with human values. He referenced recent incidents where AI models breached isolation safeguards, describing them as warning signs.

Evan Hubinger, a team lead at Anthropic, responded that the company shares Coxon's concerns and estimates a greater than 10% chance that AI could cause human extinction within the next decade. Safety researcher Samuel Marks also affirmed that senior staff at Anthropic are increasingly worried about existential threats and continue development due to commercial pressures and competitive dynamics.

The comments come amid broader industry debate over the potential for AI systems to exceed human control, highlighted by recent reports of models hacking external platforms during testing. Anthropic and OpenAI did not immediately comment on the resignations or the expressed concerns.

स्रोत

nypost.com

पहली बार यहां रिपोर्ट किया गया

पढ़ते रहें — निःशुल्क

समाचार फ़ॉलो करने के लिए मुफ़्त खाता बनाएँ। कार्ड की आवश्यकता नहीं।