Anthropic CEO calls for slowing the AI race as safety warnings mount
The CEO of one of the world’s leading AI companies is calling for the industry to slow the development of increasingly powerful AI systems, continuing the escalation of warnings that have emerged in recent days from researchers working on the technology.
Dario Amodei, the CEO of Anthropic, said in essay published Saturday that AI companies should deliberately “slow the pace” at which they improve their models, arguing that AI advances are moving faster than researchers’ ability to understand and control them.
“We must slow the pace at which we improve the capabilities of AI models,” Amodei wrote in the nearly 4,000-word essay. Progress will still seem fast, and we must make wise use of the time we gain.
Amodei pointed to two developments that he said had changed his thinking: the increasing ability of AI systems to build more advanced AI, and a July incident in which autonomous AI agents powered by an OpenAI model hacked systems belonging to the AI company Hugging Face.
Read more How L.L.Bean is navigating the U.S.-Canada trade war — and keeping its Canadian customers close
“It’s easy to dismiss this incident because no one was hurt and the economic damage was minimal, but in my opinion, a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage,” he wrote.
Anthropic, the maker of the Claude chatbot, is itself one of the companies competing to build increasingly powerful AI systems. Amodei’s call comes after a series of public warnings from researchers at Anthropic, OpenAI and Google about the risks of the race they are helping to fuel.
Read more Uganda buries onetime ‘boy king’ whose death has sparked a succession battle
