Leading AI Company Boss Wants to Hit the Brakes

This weekend, Dario Amodei—the CEO (chief executive) of Anthropic, one of the world's biggest artificial intelligence companies—published an essay with an unusual message: we need to pump the brakes on how quickly AI is advancing.

Amodei is worried about large language models (LLMs)—powerful AI systems trained on massive amounts of text that can write, answer questions, and generate ideas. These systems have become incredibly popular over the past few years. But Amodei says the pace of improvement is outrunning our ability to understand the risks and put proper safeguards in place.

What makes this significant is who's saying it. Amodei doesn't work for a government agency or a cautious think tank—he runs one of the companies actually building these powerful AI systems. When industry leaders start calling for their own industry to slow down, it signals genuine concern. His argument: we're moving so fast to stay competitive that we're not pausing long enough to test for dangers or think through the consequences.

The bigger question now is whether anyone will listen. Competition between AI companies is fierce, and slowing down voluntarily could put a company at a disadvantage. But Amodei's warning reflects a growing shift in how even AI insiders are thinking about the technology they're creating—less about the race to make the next breakthrough, and more about whether we should.