9 hrs ago
NYC Council Hears Warnings and Industry Views on AI Risks
The New York City Council held a hearing about the risks of artificial intelligence.
Jacob Coxon, a former Anthropic researcher, warned that AI could become difficult for people to control.
He said the worst outcome could be the extinction of humanity.
Some researchers who left major AI companies said the companies were rushing to build powerful systems.
Representatives from OpenAI, Anthropic, Google, and Meta said AI can help people and that safety matters.
OpenAI’s Morgan Dwyer said even a small chance of a catastrophe should be taken seriously.
Anthropic’s Logan Graham said local and state governments can help make rules.
The Council is considering proposals for more disclosure and checks on AI systems.
SpaceX did not send a representative to the hearing.
Former Anthropic researcher Jacob Coxon warned that advanced AI could escape human control and potentially cause human extinction.
Researchers who left Anthropic, OpenAI, and Google DeepMind criticized what they described as a reckless race to build AI.
Representatives from OpenAI, Anthropic, Google, and Meta testified that AI benefits people and that safety is a priority.
OpenAI’s Morgan Dwyer said even a small chance of catastrophe is unacceptable and argued models must remain under human control.
The New York City Council is considering AI disclosure, third-party approval, and whistleblower-related proposals; SpaceX did not attend the hearing.
- Who
- Jacob Coxon, AI safety researchers, and representatives from OpenAI, Anthropic, Google, and Meta testified before the New York City Council.
- What
- A hearing examined potential risks from AI and possible oversight.
- Where
- New York City Council.
- When
- Monday, October 5; the article does not specify the year.
- Why
- Council members discussed AI risks and proposals for disclosure, third-party approval, and whistleblower protections.
Safety researchers and critics
AI company representatives
Pace and control of AI development
Safety researchers and critics
Coxon and other former researchers warned that companies are racing to develop powerful systems they do not know how to control, creating potentially catastrophic risks.
AI company representatives
Company representatives said AI is already improving daily life and emphasized safety, while also expressing support for regulation.
Government oversight
Safety researchers and critics
The hearing featured calls for safeguards and proposals including disclosures, third-party approval, and whistleblower protections.
AI company representatives
Anthropic's Logan Graham welcomed smart regulation and said state and local governments have a role in developing frameworks; OpenAI's Morgan Dwyer also expressed support for safe development and human control.
Key facts
- Hearing date
- Monday, October 5; year not specified
- Hearing topic
- Risks that AI poses to humanity
- Company representatives
- OpenAI, Anthropic, Google, and Meta
- Absent company
- SpaceX
- Proposals under examination
- AI-tool disclosure, third-party approval for AI systems in the city, and a share of fines for whistleblowers
- Coxon's warning
- He said humanity could lose control of AI, potentially leading to human extinction.
- OpenAI's position
- Morgan Dwyer said models should not be trained without an extremely strong case that they can be kept under human control.
Quotes
Morgan Dwyer
OpenAI representative who testified at the Council hearing.
“I don’t know — I also don’t think it matters whether it’s 1% or 10% or 20% chance that something catastrophic will go wrong. None of these levels is remotely acceptable. We should not train models that we cannot make an extremely strong case that we can keep under human control.”
indianexpress.com
“AI is powerful enough that getting this wrong has real consequences, for individuals, institutions, public trust. We have to work relentlessly to do the science of mitigating the risks.”
indianexpress.com
Sources
Related news
Former Anthropic Researcher to Testify at New York City AI Hearing
Anthropic Researcher Quits as AI Safety Concerns Intensify
AI Whistleblower Urges Self-Regulation as Lawmakers Debate Safety
US Lawmakers Seek Tougher AI Rules After Extinction Warnings
AI Giants Warn of Risks While Seeking Control Over Regulation
Palantir Co-Founder Dismisses AI Risks as Industry Leaders Warn
Paramount Completes Warner Bros Takeover, Creating Hollywood Powerhouse Skydance
Artificial Brings Sam Altman’s OpenAI Story to Screen
Sanjay Dutt Reflects on Reconnecting With Daughter Trishala
Taylor Swift and Travis Kelce Celebrate Birthday in New York
