Home · Technology · Sep 14 archive
Let AI safety catch up
Confirmed
In Short: Top AI companies and leaders are advocating for a temporary slowdown in development to address safety concerns, as the technology advances rapidly.
In an essay, Amodei laid out a three-step proposal for changes long espoused by AI safety advocates. Anthropic, one of the companies advocating for this pause, has also announced it will unilaterally put in third-party safety auditors. "Companies like ours need to have independent auditors embedded within them to check our safety measures," Amodei said.
The breathing space may allow AI companies to skirt around increasingly hostile positions on the technology’s environmental and economic impacts, but it must also be used by governments to set safety standards without strangling innovation, according to The Indian Express. Former Anthropic employee Joe Benton added that safety researchers often feel pressured to continue developing AI because stopping could allow less cautious competitors to take the lead.
OpenAI CEO Sam Altman also weighed in, stating that his company would not launch an initial public offering this year, citing the need to focus on AI safety and alignment and cooperation between the industry and governments.
What's confirmed
- In an essay, Amodei laid out a three-step proposal for changes long espoused by AI safety advocates. Anthropic, one of the companies advocating for this pause, has also announced it will unilaterally put in third-party safety auditors. "Companies like ours need to have independent auditors embedded within them to check our safety measures," Amodei said.
- The breathing space may allow AI companies to skirt around increasingly hostile positions on the technology’s environmental and economic impacts, but it must also be used by governments to set safety standards without strangling innovation, according to The Indian Express. Former Anthropic employee Joe Benton added that safety researchers often feel pressured to continue developing AI because stopping could allow less cautious competitors to take the lead.
- OpenAI CEO Sam Altman also weighed in, stating that his company would not launch an initial public offering this year, citing the need to focus on AI safety and alignment and cooperation between the industry and governments.
What's still developing
- Technology's purpose is to advance human civilization and to accelerate human flourishing.
- Microsoft developed the draft code of conduct, which is 37 pages in total, over the last five to six months.
- LEILA FADEL, HOST: But over the weekend, top AI leaders called for tapping the brakes for the sake of safety.
- Anthropic CEO Dario Amodei has called for the artificial intelligence industry to slow its rapid development, warning that safety measures need more time to keep pace with increasingly capable AI systems.
- Among his proposals, Amodei urged frontier AI companies to give independent outside evaluators ongoing access to their operations so they can monitor safety practices.
