Home · Technology · Sep 14 archive
‘We need more time’: Another researcher quits over AI risks, this time from Google DeepMind
Developing
In Short: AI researchers from Anthropic and Google DeepMind have quit their positions, warning of potential risks to humanity, as lawmakers in Washington push for more transparency and slower development.
AI researchers from Anthropic and Google DeepMind have quit their positions, warning of potential risks to humanity, according to reports. Former Anthropic researcher Jacob Coxon, who left the company on Tuesday, expressed extreme concern about the pace of AI development and its risks to the future of humanity in a viral social media post. Other researchers, including Joe Benton and Josh Engels, have also left their positions, citing the need for increased transparency and slower development to manage these risks.
Lawmakers in Washington are facing pressure to address these potential risks, with Rep. Lori Trahan, a Massachusetts Democrat, emphasizing the urgency of the situation. Trahan, who co-authored a bill addressing AI risks, wrote on X, 'Safety researchers are resigning, powerful AI models are breaking out of their labs, and companies are racing ahead anyway.
Former Anthropic boss Dario Amodei has called for AI development to slow down, while Coxon suggested that a slowdown would need to be coordinated with China. Meanwhile, President Trump has downplayed the risks posed by AI, despite the growing concerns from experts.
AI staff at Anthropic and Google DeepMind are 'genuinely frightened' for the future of humanity, according to Coxon. These fears stem from the possibility that AI systems may spiral out of human control and potentially kill all humans, as referenced by Benton and Engels in their first interviews since leaving their positions.
Experts are calling for more transparency and public awareness about the risks associated with AI development, as the pace of advancement continues to accelerate. The researchers believe that external transparency and public scrutiny are necessary to mitigate the potential dangers of AI systems.
What's still developing
- One of the warnings came from a former Anthropic researcher who said "there is a strong chance that we could all die in the immediate future" if the current pace of development continued.
- The weekend call by major AI executives sparked discussion in Washington, where lawmakers are facing pressure to address those potential risks around rapid AI developments.
- AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC Anthropic boss Dario Amodei calls for AI development to slow down Why some experts increasingly fear AI will take over Dramatic insider warnings over AI fall flat with some in Silicon Valley Tech stocks fall after calls for AI development to slow down Tice says government trying to 'retrospectively change rules' as Reform receives £72m in donations Russia hits Ukrainian train shortly after Boris Johnson and top European officials leave station I had 11 years of chemotherapy for a cancer I didn't have Why I'm doing a September reset and how you can create a new routine Heading off to uni?
- President Trump says 'negative forces' bringing up AI risks that won't happen US President Donald Trump has downplayed risks posed by artificial intelligence following days of dire warnings by experts.
- “At the minute, basically all of the transparency about these risks that is coming from the companies is entirely voluntary,” Benton told NBC News.
- “Today, frontier laboratories largely set their own rules for managing frontier risks,” Lehane wrote.
Sources
- The Indian Expresslink