Both OpenAI and Anthropic have recently flagged incidents in which agents powered by their models went rogue.Nicolas Tucat/AFP via Getty Images

‘Gambling with our lives’: AI researcher quits Anthropic with dire warning about safety – POLITICO

by · POLITICO

An artificial intelligence researcher who worked at Anthropic — and previously OpenAI — has resigned, saying both tech giants are "gambling with our lives."

Jacob Coxon shared his exit in a post on X, warning that the world should "not underestimate the power of this technology." He added: "These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing."

Coxon said both Anthropic and OpenAI are "racing straight to self-improving superintelligence," which refers to a scenario in which AI models can develop a more capable successor of themselves, creating an unstoppable feedback loop.