Two things should make you consider what artificial intelligence could mean for humanity. One is that those working with the technology are warning about it leading to a catastrophe—human extinction, even. The other is how technological innovation is aggravating the destruction of Ukraine. These things offer conflicting lessons for whether AI’s rapid progress can or should be slowed down.
For years, leading AI bosses have signalled that their technology could become lethal. Bots may become brainy enough to outwit their creators before they are “aligned” with humanity’s goals and ethics. Bad people could use AI to wreak havoc. These warnings have become more credible as AI agents have escaped their sandboxes during testing, co-ordinated with one another and hacked organisations, including an AI lab itself. Anthropic, one model-maker, has caught people using its models for malign ends, from Mali’s intelligence services getting a mass-surveillance system built, to Houthi rebels in Yemen thought to be writing software for ballistic missiles.
Following the recent resignation of a researcher at Anthropic, public fear of AI doom has spread. In a post viewed more than 170m times, he said that it and OpenAI were “gambling with our lives”. AI is rapidly growing more potent, for good and ill. In May prediction markets priced a less-than-one-third chance of AI solving any millennium prize maths problem before 2030; on September 8th OpenAI said it had solved one of them, causing angst among mathematicians. On September 12th Sam Altman and Elon Musk, two AI titans, endorsed a call by Dario Amodei, the head of Anthropic, to “pace the frontier”, ie, to slow AI’s progress. Those in favour of a slowdown include Bernie Sanders, a left-wing senator, and Steve Bannon, a right-wing populist.
Can the AI arms race be stopped?https://t.co/iuG0rZA8CW
— Héctor Dedrick Guerrero (@hectordguerrero) September 17, 2026
