1 hr ago
Anthropic Researcher Leaves Unvested Equity Over AI Extinction Concerns
Jacob Coxon used to work at Anthropic, a company that builds advanced AI.
He quit shortly before some of his company shares would have become his.
That means he may have given up a lot of money.
He said he left because he worries advanced AI could become dangerous to people.
He does not think robots will suddenly attack humans like in a movie.
Instead, he worries that AI systems may become difficult to understand and control.
He also said companies might rush and skip safety work while competing with one another.
Coxon said he had not personally seen Anthropic put competition ahead of safety.
His post became very popular, but it is not yet known whether his resignation will change the company or the wider AI industry.
Former Anthropic researcher Jacob Coxon resigned two months before company stock was due to vest.
Coxon said he did not want to help make Anthropic more valuable if he no longer supported its direction.
His warnings that advanced AI could potentially destroy humanity were viewed more than 115 million times on X.
Coxon said competitive pressure could lead AI companies to skip safety steps, although he had not seen Anthropic do so.
He argued that AI systems are becoming harder to understand and control as companies make them more powerful.
- Who
- Former Anthropic researcher Jacob Coxon.
- What
- Coxon resigned before his Anthropic equity vested and publicly warned that advanced AI could pose an existential threat to humanity.
- Where
- The resignation and warnings concerned Anthropic and were shared publicly on X.
- When
- He resigned two months before his stock was due to vest; his warnings were posted the day before the report about his unvested equity.
- Why
- Coxon said he no longer wanted to help make Anthropic more valuable because he was concerned about AI safety, competitive pressure, and loss of control over advanced systems.
Warnings About AI Risks
Evidence of Current Safety Practices
Threat from advanced AI
Warnings About AI Risks
Coxon believes advanced AI could become difficult to understand and control, with human extinction a possible outcome.
Evidence of Current Safety Practices
The article does not report an immediate catastrophe and says Coxon was not predicting that robots would attack people next week.
Anthropic’s safety record
Warnings About AI Risks
Coxon worries that future competition among AI companies could pressure teams to cut safety corners.
Evidence of Current Safety Practices
Coxon said he had not personally seen Anthropic sacrifice safety to compete, and Anthropic is described as having a reputation as a responsible AI lab.
Industry urgency
Warnings About AI Risks
Coxon said fears about falling behind China or rivals can be exaggerated and used to justify moving faster.
Evidence of Current Safety Practices
The article presents competitive pressure as a reason companies may prioritize rapid development, even though it does not identify a specific company defending that approach.
Key facts
- Researcher
- Jacob Coxon, a former Anthropic researcher
- Unvested equity
- Coxon left two months before his Anthropic stock was due to vest
- Post reach
- His warnings were viewed more than 115 million times on X
- Core warning
- He said advanced AI could potentially wipe out humanity before the end of the decade
- Previous employer
- Coxon still holds stock from OpenAI, but not from Anthropic
- Safety concern
- He said competitive pressure could cause companies to skip safety steps
- Current assessment
- Coxon said he had not personally seen Anthropic sacrifice safety to beat competitors
Quotes
Jacob Coxon
Former Anthropic researcher who resigned and publicly warned about advanced AI risks
“AI could kill all humans”
NDTV
Sources
Related news
Former Anthropic Researcher Warns AI Could Kill Humanity This Decade
OpenAI Slows AI Race as Altman Elevates Safety
OpenAI Ethics Lead Resigns Less Than a Year After Joining
Sanders Backs Permanent Ban on Superintelligent AI Development
Anthropic Hiring Interviews Highlight Tension Between Mission and Profit
Anthropic CEO Defends AI Warnings Amid Trust Crisis
Trump’s Canada Tariffs Draw Senate Fire Over Trade War
Xi India Visit May Ease Thaw, Despite Business Suspicion
August Ties Record as World’s Hottest Month, Scientists Say
China, Russia Presidents Expected for BRICS Summit Amid Delhi Security
