Home · Technology · Sep 30 archive
OpenAI’s Jev clone could help the frontier lab stop its swarming agents
Confirmed
In Short: OpenAI has launched a new Decisions API, similar to TypeSafe AI's Jev model, to help monitor and secure AI agents.
TechCrunch reports that OpenAI's Decisions API, revealed at Dev Day, is designed to provide similar functionality to TypeSafe AI's Jev model, which was released earlier this month.
CEO Sam Altman mentioned the Decisions API in an aside during the event, indicating its potential to monitor and secure AI agents.
OpenAI's Decisions API is part of a broader strategy to address safety concerns and ethical implications of AI development.
OpenAI's chief scientist, Jakub Pachocki, has argued for coordinated efforts to slow down AI development to ensure safety.
OpenAI's new Astra model, launched in June, has raised concerns among AI safety experts due to its advanced cyber capabilities.
OpenAI's Preparedness Framework includes pausing development once a model reaches the Critical threshold.
The company has also been grappling with the ethical implications of its technology, as seen in the recent incident involving 10,000 AI agents solving the Navier-Stokes problem.
OpenAI and Anthropic have been working towards international coordination on AI development, with both companies releasing new versions of their AI models to improve efficiency and lower costs.
OpenAI's Decisions API is expected to play a crucial role in monitoring and securing AI agents, addressing safety concerns and ethical implications.
OpenAI's strategy includes seeking legal guidance, coordinating with other companies, and implementing safety measures to ensure responsible AI development.
What's confirmed
- TechCrunch reports that OpenAI's Decisions API, revealed at Dev Day, is designed to provide similar functionality to TypeSafe AI's Jev model, which was released earlier this month.
- CEO Sam Altman mentioned the Decisions API in an aside during the event, indicating its potential to monitor and secure AI agents.
- OpenAI's Decisions API is part of a broader strategy to address safety concerns and ethical implications of AI development.
- OpenAI's chief scientist, Jakub Pachocki, has argued for coordinated efforts to slow down AI development to ensure safety.
- OpenAI's new Astra model, launched in June, has raised concerns among AI safety experts due to its advanced cyber capabilities.
- OpenAI's Preparedness Framework includes pausing development once a model reaches the Critical threshold.
- The company has also been grappling with the ethical implications of its technology, as seen in the recent incident involving 10,000 AI agents solving the Navier-Stokes problem.
- OpenAI and Anthropic have been working towards international coordination on AI development, with both companies releasing new versions of their AI models to improve efficiency and lower costs.
- OpenAI's Decisions API is expected to play a crucial role in monitoring and securing AI agents, addressing safety concerns and ethical implications.
- OpenAI's strategy includes seeking legal guidance, coordinating with other companies, and implementing safety measures to ensure responsible AI development.
What's still developing
- It’s not clear how similar Decisions API will be to Jev, since OpenAI released it as a limited preview and, thus far, TechCrunch hasn’t spotted developers running it through its paces.
- Decisions API isn’t the only Jev-like API on the internet — other startups are rolling out similar models; OpenAI won’t be the last tech giant to produce one.
- After just weeks, it seems clear that these models have a future ahead of them, and one likely application is monitoring and securing AI agents.
- It’s the kind of thing TypeSafe was hoping to achieve — and now OpenAI has seen the value as well.
- OpenAI’s Decisions API seems to be the same sort of product.
- TypeSafe didn’t respond to TechCrunch’s questions about the new product, but CEO Diogo Almeida, a former OpenAI engineer who co-invented reinforcement learning, joked on X about the beginning of the clone wars.
- He added that OpenAI’s interest could be “a sign…that building in a System One compatible way is the future.” (“System One” is TypeSafe’s term of art for fast, intuitive thinking, versus “System 2,” which it applies to deliberate reasoning.) The subtext here is that LLMs as we know them aren’t the right solution for a lot of software because they are comparatively slow and expensive.
- OpenAI has asked members of Congress in recent weeks for clear guidance about whether orchestrating an industry-wide slowdown on frontier AI development would be legal, people close to the company tell WIRED.
- Last weekend, OpenAI’s chief scientist, Jakub Pachocki, published a blog post arguing that the best path forward for the AI research world includes “coordinating to slow down future development,” which he thinks will be key to ensuring that self-improving AI systems are safe.
- “First step is for industry leaders OpenAI and Anthropic to stop feuding and work on a pacing proposal together,” John Schulman, an OpenAI cofounder who is now chief scientist at the rival AI lab Thinking Machines, wrote in a post on X earlier this week.
- This week, former Anthropic and OpenAI researcher Jacob Coxon added to the growing alarm when he issued a stark public warning that AI developers were putting humanity at risk.
- “But even if most safety collaborations would ultimately survive antitrust scrutiny, legal uncertainty can act as a powerful deterrent.” OpenAI did not respond to a request for comment ahead of publication.