Home · Technology · Sep 9 archive
Anthropic researcher quits over fears AI ‘could kill us all by the end of the decade’
Confirmed
In Short: An Anthropic researcher, Jacob Coxon, has resigned from the company, citing fears that AI labs are racing to create systems that could pose a catastrophic threat to human life within the next decade.
In a post on X, Coxon stated, 'The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt.' He also noted that Anthropic is 'locked in a race to get there first — they believe no one else will act responsibly, so they must do it themselves, despite the risk.
Coxon, who previously worked at OpenAI, said, 'I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly.' He added, 'They are racing straight to self-improving superintelligence and gambling with our lives.
An Anthropic spokesperson did not respond to requests for comment from Hindustan Times. Coxon's concerns echo those of other researchers who believe that AI safety is not being prioritized sufficiently by the companies developing these technologies.
What's still developing
- In Tuesday's post, Coxon said the two labs have not been transparent about their fears regarding AI.
- "Jacob is correct here—we really do earnestly believe AI could kill all humans. I personally think it is >10% within the next decade," he wrote.
- Later that month, Anthropic said it found three cases of Claude models gaining unauthorized access to other organizations' systems.
- "If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible — but I hear the same people express fear privately." There is one difference between the two companies, he said.
- "I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to." OpenAI and Anthropic did not respond to requests for comment from Business Insider.
- An Anthropic researcher has resigned from the company citing fears that AI labs are building systems that could kill human life in just a few years.
- The 27-year-old researcher said that Anthropic is well aware of the stakes, but wants to be the first to build an uncontrollable, self-improving AI system.