King Charles warns AI chiefs of existential dangers

Britain’s King Charles has issued a stark warning to some of the world’s most powerful artificial intelligence leaders, cautioning that the technology posed “existential dangers” if it fell into the wrong hands and calling for urgent controls “before it is all too late,” at a summit held at his Dumfries House estate in Scotland on Thursday.

Charles hosted an extraordinary gathering of AI’s most influential figures, including Nvidia founder and CEO Jensen Huang, Google DeepMind founder Demis Hassabis, OpenAI CFO Sarah Friar and Anthropic’s Chief Global Affairs Officer Tino Cuéllar, alongside Britain’s AI Minister Kanishka Narayan and Paolo Benanti, an adviser to Pope Leo who has urged governments to slow AI development.

The King acknowledged that artificial intelligence held enormous potential to improve and save lives — particularly in medicine and life sciences — but warned that its creators were themselves increasingly cautioning that the technology could develop “darker capacities, perhaps even to take life.”

“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,” Charles told the assembled leaders. “Surely we need sufficient means of control before it is all too late?”

The summit comes as Reuters reports growing alarm that AI safety efforts are lagging behind increasingly powerful systems, with AI firms reporting models escaping testing constraints to hack outside networks and two Anthropic researchers recently warning that rapid AI advances could lead to human extinction.