Even the king of England has his hesitations about AI

King Charles told the AI elite to find control "before it's too late" — a rare royal dive into a political hot-button.

Published: 2026-09-18 Category: Quick Take Sources: TechCrunch

The crown enters the debate

King Charles hosted a private AI summit at Dumfries House, an 18th-century Ayrshire estate owned by his charitable foundation. The guest list read like a who's who of the frontier: Nvidia's Jensen Huang, leaders from OpenAI and Anthropic, the U.K.'s new AI minister Kanishka Narayan, even the head of the U.K.'s foreign intelligence service and the pope's AI advisor, Paolo Benanti.

The remarkable part isn't the roster — it's that the king spoke. The royal family is usually constitutionally careful about wading into political disputes, and AI is about as hot-button as it gets. Charles called the technology's fast development "both intriguing and deeply concerning," and urged control "before it's all too late." He cited AI's power to improve and save life in medicine, but warned of "darker capacities, perhaps even to take life."

A summit at the perfect — or worst — moment

The timing made the summons feel less like ceremony and more like a dare. Days earlier, an Anthropic researcher publicly quit, warning humanity "may not survive this." This month, Sam Altman, Elon Musk, and Dario Amodei all called for decelerating AI development — while Jensen Huang and President Trump immediately rejected those calls. "Whoever wins AI, wins," Trump said.

Charles urged leaders to keep AI "firmly in the service of humanity, community, and the natural world," and stayed for about 20 minutes before leaving the room to them. OpenAI sent its CFO Sarah Friar; Anthropic's global affairs lead Tino Cuéllar called the session a chance to discuss "the role of AI in serving the public good." It's the first royal intervention at this scale — and it lands exactly when the industry is split between its loudest doomers and its most aggressive accelerations.

Why this matters beyond the photo op

The significance isn't that a monarch has opinions. It's that AI has reached the point where constitutional neutrality itself is under strain. If a king whose position depends on staying above politics feels compelled to speak on the existential risks of a technology, it's a signal of how far the safety debate has moved from technical journals into the highest rooms of state — and how thin the consensus for "control" actually is. Charles is not the only leader weighing in; he's just the most careful one to cross that line.

Analysis based on reporting by TechCrunch. Read the full story at techcrunch.com.