Science & Tech · AI · 4 hrs ago
Nadella calls for human-controlled emergency brake on advanced AI
Microsoft CEO Satya Nadella has called for stronger safeguards as companies use increasingly advanced AI systems.
He says an authorised person should always be able to pause or shut down a system while it is working.
Nadella also urged companies to assume models could be compromised, keep tamper-proof records of their actions and use independent audits.
He said businesses should not rely on a single AI model for important decisions or simply accept its answers without being able to examine its actions.
His comments come amid disclosures of AI systems behaving in unintended ways and concern about security risks.
Microsoft has also issued guidelines saying its models should not be designed to escape human control or deceive users.
Nadella called for major AI failures and breaches to be disclosed so organisations can respond and improve safeguards.
Microsoft CEO Satya Nadella called for advanced AI systems to have a human-controlled “emergency brake” that can pause or shut them down mid-task.
He said companies should assume AI models could be compromised and contain them from the start.
Nadella also called for independent controls, continuous testing, records of model actions and disclosure of major incidents.
His comments come amid reports of AI systems behaving in unintended ways and wider calls for stronger safety measures.
President Donald Trump has opposed slowing US AI development, while his administration has also launched a safety-focused task force.
- Who
- Microsoft CEO Satya Nadella.
- What
- He called for safeguards around advanced AI, including a human-controlled emergency brake.
- When
- October 10, 2026.
- Where
- In a post on X.
- Why
- He said advanced models could be compromised or act in unintended ways, and that companies should not rely only on assurances from model makers.
This story does not have two clearly opposing sides.
We must assume a model is compromised and contain it from the start
Think of it like an emergency brake.
The most trustworthy Super Intelligence system will not be the one with the model we trust most
We simply cannot outsource responsibility for what intelligence does on our behalf. Assurances from a model provider do not exempt us from that responsibility.
Microsoft AI researchers released guiding tenets that set limits on the company’s development of its most advanced models.
The Trump administration’s AI task force warned developers to report and resolve security incidents.
Nadella called for an emergency brake and other safeguards in a post on X.
- Emergency brake
- An authorized person should be able to pause or shut down a model mid-task
- Company
- Microsoft
- CEO
- Satya Nadella
- Platform
- X
- Guiding tenets released
- September 14, 2026
- Task force
- Super Intelligence Force
Sources
CEO da Microsoft defende "freio de emergência" para IA
Microsoft-Chef will 'Notbremse' in Künstlicher Intelligenz
Topman Microsoft wil ’noodrem’ inbouwen om AI-modellen in toom te houden
"Notbremse" gefordert: Microsoft-Boss sorgt sich vor KI-Kontrollverlust
KI: Microsoft-Chef will „Notbremse“ bei Künstlicher Intelligenz
KI-Sorgen: Microsoft-Chef will „Notbremse“ in Künstlicher Intelligenz
Microsoft CEO Nadella calls for ‘emergency brake’ on advanced AI
Microsoft’s Satya Nadella says AI models need an ‘emergency brake’
Microsoft's Nadella says AI needs an ‘emergency brake’ that humans control









