Home · Technology · Sep 14 archive
Why are AI leaders calling for a slowdown? The real reasons companies are panicking
Confirmed
In Short: AI leaders are calling for a slowdown in the development of advanced artificial intelligence (AI) systems, citing concerns over potential risks to humanity, according to reports.
AI leaders are calling for a slowdown in the development of advanced artificial intelligence (AI) systems, citing concerns over potential risks to humanity, according to reports. Dario Amodei of Anthropic and Sam Altman, CEO of OpenAI, have both advocated for regulation and a 'slowdown' of the technology's development, reflecting growing unease among experts and industry insiders.
Amodei and other AI researchers have emphasized the need for deliberate pacing in AI model improvements, given the potential risks. This comes in the wake of recent incidents, such as top Chinese AI companies copying cutting-edge models from American firms, which have heightened concerns about the rapid advancement of AI technology.
The calls for a slowdown are not just coming from outside the industry. Anthropic and OpenAI have themselves admitted that their products could pose an existential risk to the world, a strategy that is unusual for companies to openly acknowledge. While many industry leaders have been willing to suggest that their products could wipe out humanity, the recent incidents suggest that companies are not sufficiently careful about the way they are rolling out their technology.
The push for a slowdown is also influenced by the competitive landscape between the United States and China. President Donald Trump's rebuff of industry leaders' warnings and the focus on beating China in AI development have created a complex environment where safety concerns are often overshadowed by competitive priorities. The Global Times, a state-run newspaper, has criticized the calls for a slowdown as a 'Cold War playbook' targeting China.
What's confirmed
- AI leaders are calling for a slowdown in the development of advanced artificial intelligence (AI) systems, citing concerns over potential risks to humanity, according to reports. Dario Amodei of Anthropic and Sam Altman, CEO of OpenAI, have both advocated for regulation and a 'slowdown' of the technology's development, reflecting growing unease among experts and industry insiders.
- Amodei and other AI researchers have emphasized the need for deliberate pacing in AI model improvements, given the potential risks. This comes in the wake of recent incidents, such as top Chinese AI companies copying cutting-edge models from American firms, which have heightened concerns about the rapid advancement of AI technology.
- The calls for a slowdown are not just coming from outside the industry. Anthropic and OpenAI have themselves admitted that their products could pose an existential risk to the world, a strategy that is unusual for companies to openly acknowledge. While many industry leaders have been willing to suggest that their products could wipe out humanity, the recent incidents suggest that companies are not sufficiently careful about the way they are rolling out their technology.
- The push for a slowdown is also influenced by the competitive landscape between the United States and China. President Donald Trump's rebuff of industry leaders' warnings and the focus on beating China in AI development have created a complex environment where safety concerns are often overshadowed by competitive priorities. The Global Times, a state-run newspaper, has criticized the calls for a slowdown as a 'Cold War playbook' targeting China.
What's still developing
- Such worries date back decades, with Alan Turing writing in the 1950s that should intelligent machines become possible, they could take control. 'There is a possibility of human extinction,' former Anthropic employee says about AI In the last few years, major AI companies have been racing to develop increasingly capable systems, both for profit and in pursuit of creating what they call super intelligence - theoretical tech which is smarter than humans.
- Campaigners such as PauseAI have also urged companies like Google to halt efforts to build highly capable AI systems AI researchers, experts and bosses worried about the technology's potential to endanger humanity have outlined unsettling scenarios.
- Why some experts increasingly fear AI will take over Dramatic insider warnings over AI fall flat with some in Silicon Valley Dario Amodei of Anthropic and Sam Altman, chief executive of OpenAI, have both called for regulation and a "slowdown" of the tech's development.
- The OpenAI co-founder also said companies did not - and would not - wait for governments to act.
- Amodei’s essay came just a few days after U.S. agencies published an alert saying that top China AI companies have systematically copied cutting-edge AI models from American companies.
- The state-run Global Times newspaper had a more blunt tone Sunday, blasting the call for an industrywide slowdown as “packed with containment provisions targeting China and is, in essence, a ‘Cold War playbook’ for the AI sector.” AI has advanced at a breakneck speed, with models rapidly getting smarter, faster and cheaper.
- But another reason for the calls for a slow down is that companies themselves clearly feel that they do not have the time to ensure that their systems are properly safeguarded.
- They noted that such a decision would be difficult – requiring multiple companies to commit to slowing down under the same conditions, and being able to verify that others were keeping to that commitment – but that Anthropic would expect to “slow down or temporarily pause” development, if others did so.