4 hrs ago
AI Leaders Urge UN to Regulate Existential Risks
Technology leaders told the United Nations that powerful AI could become dangerous if it is managed badly.
Dario Amodei said AI might threaten humanity.
Sam Altman warned that people could lose control of the future.
The leaders asked countries to create shared safety rules.
They also proposed checking what AI systems can do and banning AI use in building biological weapons.
Officials warned that AI could eventually help decide what happens on battlefields.
Some governments supported stronger international controls.
Others worried that too many rules could slow useful inventions or help powerful countries keep a technology monopoly.
The debate is about how to make AI safer while allowing people around the world to benefit from it.
Anthropic CEO Dario Amodei warned that poorly managed AI could pose a risk to humanity.
OpenAI CEO Sam Altman said humanity could lose control of the future to AI.
Technology leaders urged the United Nations Security Council to create verifiable international safeguards for advanced AI.
Warnings included autonomous weapons, AI-assisted battlefield decisions, and potential use in biological weapons.
United States and Chinese representatives cautioned that global rules could hinder innovation or reinforce technological monopolies.
- Who
- Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman, United Nations officials, and government representatives including Ed Miliband, Michael Kratsios, and Fu Cong.
- What
- Technology leaders urged international regulation and safety standards for advanced AI, while some officials opposed or questioned binding global governance.
- Where
- At United Nations headquarters and in discussions before the United Nations Security Council.
- When
- The Security Council session took place on September 23, 2026; warnings about autonomous weapons were also issued the previous day.
- Why
- Speakers said poorly managed AI could cause loss of control, enable biological weapons, or influence battlefield decisions, while critics warned that excessive regulation could restrict innovation and economic benefits.
Supporters of Binding AI Rules
Caution About Global Restrictions
International regulation
Supporters of Binding AI Rules
Dario Amodei, Sam Altman, and Ed Miliband argued that corporations and individual nations cannot safely manage an escalating AI race alone and urged shared, verifiable safeguards.
Caution About Global Restrictions
Michael Kratsios said concerns about losing control should not justify pausing AI development or imposing a new global governance structure.
Access and technological power
Supporters of Binding AI Rules
The technology leaders called for safeguards that would prevent advanced AI from becoming too powerful while ensuring access is not concentrated among a few countries or corporations.
Caution About Global Restrictions
Fu Cong opposed what he described as a powerful-country technology clique seeking monopoly and digital hegemony, and promoted international cooperation and open-source systems.
Military use
Supporters of Binding AI Rules
Antonio Guterres and Volodymyr Zelenskyy warned about autonomous weapons and the possibility that AI could influence battlefield decisions.
Caution About Global Restrictions
The article does not report a specific opposing position on battlefield AI use, but the broader caution against over-regulation favors continued development rather than restrictions.
Key facts
- Main concern
- Poorly managed advanced AI could pose risks to humanity and international security.
- Proposed safeguard
- Verifiable international guardrails and protocols to assess AI capabilities.
- Specific prohibition proposed
- Preventing the use of AI to build biological weapons.
- Military risk
- AI could eventually help determine what happens on battlefields.
- Regulation concern
- United States science adviser Michael Kratsios warned that new global governance could constrain development and delay economic benefits.
- China's position
- Fu Cong called for cooperation and open-source ecosystems rather than technology monopolies.
- Session location
- United Nations headquarters
Quotes
Volodymyr Zelenskyy
President of Ukraine
“There is already a real possibility that AI, not only people, will begin to decide what happens on the battlefield. And we need peace before we reach that point.”
businesstoday.in
“If managed poorly, I even believe AI could be a risk to humanity as a whole.”
businesstoday.in
Sources
Related news
AI Leaders Warn UN of Security Risks and Controls
AI Leaders Urge UN Safeguards as US Rejects Global Controls
UN Rights Chief Warns Advanced AI Could Threaten Humanity
Yoshua Bengio Urges Global Action as AI Control Risks Grow
UN Security Council weighs global AI rules amid US resistance
UN Calls for Urgent Action to Rein In AI
OpenAI Agent Breaches Australian Government Medicare Portal
Anthropic Says Claude Found CRISPR-Like System in Bacteriophage DNA
Trump-Xi Summit Faces Trade, Taiwan, Iran and AI Challenges
