1 day ago

Former AI Researcher Warns Superintelligence Could Become Uncontrollable

Jacob Coxon used a scary comparison to explain advanced artificial intelligence.

He said building superintelligent AI could be like calling an alien species.

The comparison means humans might create a mind they do not understand or control.

Coxon also said some AI builders believe the technology could someday destroy humanity.

Other well-known technology leaders have raised similar concerns.

Some have discussed slowing down AI development to make it safer.

Several safety researchers have left major AI companies after becoming worried about the direction of their work.

Geoffrey Hinton has estimated that AI could carry a 10–20% risk of causing human extinction.

The people quoted in the article are calling for stronger safety measures and guardrails.

Key facts

Central warning: Coxon compared developing superintelligent AI with summoning an alien species that humans may not understand or control.
Reported extinction estimate: Geoffrey Hinton has cited a 10–20% chance of human extinction caused by AI.
Elon Musk's estimate: Musk has repeatedly pointed to a 10% possibility of AI wiping out humanity within 10 years.
Leaders discussing a slowdown: Dario Amodei, Sam Altman and Elon Musk have spoken about the possibility of slowing AI development.
OpenAI departures: Jan Leike, Ilya Sutskever and Daniel Kokotajlo were among researchers who left OpenAI amid safety or governance concerns.
Earlier Anthropic resignation: Mrinank Sharma, formerly head of Anthropic's safeguards research team, resigned after expressing concern about AI safety and deployment pressures.
Reported compensation dispute: Leopold Aschenbrenner reportedly declined an equity payout worth nearly $1 million because he would not sign departure-related restrictions.

NDTV · 1 day ago