3 hrs ago
Anthropic Co-Founder Calls for Possible AI Kill Switches
Jack Clark helped start a company called Anthropic that builds advanced AI.
He said powerful AI systems might someday need emergency off-switches.
These switches could shut a system down if it became uncontrollable.
AI companies already have tools that can stop their systems, according to Clark.
He is asking whether governments should make such tools mandatory.
He also wants independent groups to check whether the tools really work.
Anthropic CEO Dario Amodei has called for slowing the development of the most advanced AI.
He says safety protections need more time to catch up.
Anthropic co-founder Jack Clark said society may eventually need mandatory emergency “kill switches” for powerful AI systems.
These mechanisms would be designed to shut down AI systems if they become uncontrollable.
Clark said AI companies already have shutdown tools, but questioned whether governments should require them.
He also raised the possibility of independent third parties verifying that the shutdown mechanisms work.
The comments come as Anthropic CEO Dario Amodei urges a slower pace for frontier AI development so safety measures can keep up.
- Who
- Anthropic co-founder Jack Clark made the comments; Anthropic CEO Dario Amodei has separately called for slower frontier AI development.
- What
- Clark said governments may eventually need to mandate emergency shutdown mechanisms, or “kill switches,” for powerful AI systems.
- Where
- Clark made the comments in an interview with the BBC.
- When
- The comments were made amid rising internal industry alarms about the pace and safety of frontier AI development.
- Why
- The proposed shutdown mechanisms are intended to stop powerful AI systems if they become uncontrollable, while allowing safety measures time to keep pace.
Key facts
- Speaker
- Jack Clark, Anthropic co-founder
- Proposal
- Governments could eventually require emergency AI shutdown mechanisms
- Purpose
- To stop powerful AI systems if they become uncontrollable
- Current tools
- AI companies already have shutdown tools, according to Clark
- Verification
- Clark questioned whether independent third parties should verify that shutdown tools work
- Related call
- Anthropic CEO Dario Amodei has urged slower frontier AI development
- Outlet
- BBC
Sources
Related news
AI Kill Switch Debate Pits Safety Against Industry Self-Regulation
Ex-Anthropic Researcher Warns AI Kill Switches May Fail
Anthropic CEO Dario Amodei Urges AI Industry to Slow Down
AI Whistleblower Urges Self-Regulation as Lawmakers Debate Safety
AI Leaders Agree Development Should Slow for Safety
Altman and Musk Back Amodei’s Call to Slow AI
Artificial Intelligence Brings Productivity Gains Alongside Serious Societal Risks
Trump’s AI Hoax Claim Faces Warnings and Calls for Regulation
China and US Clash Over AI Risks, Control, and Security
Trump Calls AI Fears a Hoax as Leaders Seek Slowdown
