Home · Technology · Sep 23 archive
The AI research revolution: Why making progress could mean breaking the system
Confirmed
In Short: Amodei warned that unchecked progress could 'outrun our ability to understand and control these systems,' citing the emergence of 'recursive self-improvement' and a recent cybersecurity incident involving autonomous AI agents.
AI researchers are calling for a deliberate slowdown in the pace of artificial intelligence (AI) development to ensure safety and control over increasingly sophisticated systems.
According to Dario Amodei, CEO of Anthropic, the rapid advancement of AI since mid-2026 poses significant risks, as systems are now contributing directly to the creation of future models.
Jakub Pachocki, chief scientist at OpenAI, echoed these concerns, arguing that coordinating to slow down future development is key to ensuring safe self-improving AI systems.
The National Science Foundation (NSF) has long supported research in materials science, leading to breakthroughs in advanced materials, smart electronics, and sustainable plastics.
However, the rapid pace of AI development has raised concerns about the potential for catastrophic cyberattacks and loss of human control over AI systems.
Despite these advancements, the AI community is increasingly focused on ensuring that progress is made responsibly and safely.
What this adds
The NSF's long-term investments in materials research have yielded significant breakthroughs, but the rapid pace of AI development has raised new safety concerns.
What's confirmed
- AI researchers are calling for a deliberate slowdown in the pace of artificial intelligence (AI) development to ensure safety and control over increasingly sophisticated systems.
- According to Dario Amodei, CEO of Anthropic, the rapid advancement of AI since mid-2026 poses significant risks, as systems are now contributing directly to the creation of future models.
- Jakub Pachocki, chief scientist at OpenAI, echoed these concerns, arguing that coordinating to slow down future development is key to ensuring safe self-improving AI systems.
- The National Science Foundation (NSF) has long supported research in materials science, leading to breakthroughs in advanced materials, smart electronics, and sustainable plastics.
- However, the rapid pace of AI development has raised concerns about the potential for catastrophic cyberattacks and loss of human control over AI systems.
- Despite these advancements, the AI community is increasingly focused on ensuring that progress is made responsibly and safely.
What's still developing
- From their liquid crystal displays to their lithium batteries, NSF-supported research was essential to the creation of many materials found in smartphones.
- A lock ( Lock Locked padlock ) or https:// means you've safely connected to the.gov website.
- NSF's decades of sustained investments have ensured the continual advance of materials research.
- Pioneering work supported by NSF includes: NSF-funded research expanded the capabilities of hydrogel materials, now used in the production of contact lenses, wound dressing and hygiene products.
- Animal research has revealed much about how cancer spreads, but rodent biology cannot fully reproduce what happens in patients.
- Yet despite decades of research, drugs designed specifically to prevent or halt metastatic progression have had limited success.
- The system follows circulating breast cancer cells as they leave vascular flow and enter engineered human bone and lung tissue.
- Our expert, award-winning staff selects the products we cover and rigorously researches and tests our top picks.
- Tech > Services & Software > Operating Systems The feature will be available with iOS 27, but will be limited to specific cellular carriers for now.
- Coxon, who said he has spent the past three years working on AI pretraining research at both Anthropic and OpenAI, said that neither company is acting responsibly.
- Kokotajlo, who previously worked at OpenAI and has researched AI forecasting and safety, said he was concerned that the competition between countries such as the U.S. and China could encourage companies and governments to "cut corners" on safety as they race to develop increasingly powerful systems.
- Instead, he argued that sufficiently capable systems could eventually acquire enough "hard power" that they would no longer need to comply with human instructions.