12 hrs ago
Former Anthropic Researcher to Testify at New York City AI Hearing
New York City lawmakers are planning a hearing about rules for artificial intelligence.
Former Anthropic researcher Jacob Coxon is expected to speak about risks he sees in advanced AI.
He has warned that people building AI may not be able to control how powerful it becomes.
Other former researchers and representatives from major technology companies are also expected to answer questions.
City lawmakers are considering ways to protect people from possible AI-related harms.
One idea would reward whistleblowers who report violations.
Other ideas include letting some people take legal action and checking certain AI systems before they are used in the city.
The hearing will help lawmakers consider what rules the city should adopt.
Jacob Coxon is expected to testify at a New York City Council hearing at Speaker Julie Menin’s request.
Coxon left Anthropic last month and has warned publicly about potential dangers from advanced AI.
Former researchers Alex Turner and Daniel Kokotajlo are also expected to appear; Turner confirmed his plan to attend.
Representatives of Anthropic, OpenAI, Google and Meta Platforms are expected to face questions at the hearing.
Proposals under consideration include whistleblower rewards, legal avenues for some people harmed by AI, and independent checks of certain systems before deployment.
- Who
- Jacob Coxon, other former AI researchers, technology company representatives and New York City lawmakers.
- What
- A City Council hearing on AI risks and proposed safeguards; Coxon is expected to testify.
- Where
- New York City.
- When
- At an upcoming hearing; the article does not provide a date.
- Why
- City lawmakers are considering local oversight and safeguards for AI systems and potential harms.
Stronger local safeguards
Limits and concerns around city regulation
AI safety oversight
Stronger local safeguards
Coxon has raised serious concerns about advanced AI risks, and lawmakers are considering safeguards and oversight.
Limits and concerns around city regulation
Representatives of major AI companies are expected to answer lawmakers' questions; the articles do not specify their positions on the proposed measures.
Local authority
Stronger local safeguards
City officials are pursuing measures to address potential AI risks and harms in New York City.
Limits and concerns around city regulation
The proposals could test how far a municipal government can regulate companies in a rapidly evolving national industry.
Key facts
- Expected witness
- Jacob Coxon, a former Anthropic researcher
- Hearing requested by
- New York City Council Speaker Julie Menin
- Other expected former researchers
- Alex Turner and Daniel Kokotajlo; Turner confirmed he intends to attend
- Companies expected to participate
- Anthropic, OpenAI, Google and Meta Platforms
- Whistleblower proposal
- Allow AI whistleblowers to receive part of fines or penalties recovered after reported violations
- Other proposed safeguards
- Legal avenues for some people harmed by AI and independent third-party checks for certain systems before city deployment
- Participation precedent
- City lawmakers subpoenaed SpaceX's artificial intelligence division after it did not respond to requests to appear
Quotes
Jacob Coxon
Former Anthropic researcher and AI whistleblower
“people building AI earnestly believe that it could kill us all by the end of the decade”
livemint.com
firstpost.com
“Even working on safety at Anthropic felt like being complicit in the race”
livemint.com
Sources
Related news
Anthropic Researcher Quits as AI Safety Concerns Intensify
AI Whistleblower Urges Self-Regulation as Lawmakers Debate Safety
Jacob Coxon’s Resignation Reignites Debate Over AI’s Existential Risks
Anthropic CEO Agrees AI Risk Warning, Rejects Single Extinction Odds
Anthropic Researcher Leaves Unvested Equity Over AI Safety Fears
US Lawmakers Seek Tougher AI Rules After Extinction Warnings
Robert De Niro Hosts Anupam Kher for New York Lunch
Iran Reviews US Response to Seven-Day Plan for Ceasefire
Rajabhau Waje Selected for India’s UNGA Parliamentary Delegation
New York’s First Muslim Film Festival Showcases Women Directors
