Archive · 18 Sep 2026
Anthropic Urges Transparency as AI Systems Move Toward Self-Improvement
Anthropic is a company that builds advanced artificial intelligence.
It says AI is increasingly helping people create newer and more powerful AI.
The company wants labs to share more information about how quickly this is happening.
It also wants measurements showing how much AI is building future versions of itself.
Anthropic says this could help people understand when AI is becoming difficult to supervise.
The company proposed rules requiring safety reports and other transparency measures.
CEO Dario Amodei said AI progress is moving very quickly and that labs should slow down.
He also said this does not mean people need to panic or stop all AI development.
Anthropic says AI systems are increasingly helping build more capable AI models.
The company called for public measurements of AI self-improvement and development resources.
Anthropic said greater transparency could narrow the gap between labs and the public.
It warned that accelerating AI development could make systems harder for humans to control.
CEO Dario Amodei said frontier labs should slow development but did not call for shutting it down.
- Who
- Anthropic and its CEO, Dario Amodei.
- What
- Anthropic proposed greater transparency and measurement of AI development, including AI systems’ role in building future models.
- When
- The proposal was reported on September 18; Amodei’s warning was made earlier in an interview on CBS News Sunday Morning.
- Where
- California, United States, where Anthropic’s statement was reported.
- Why
- Anthropic said public information is needed to assess the pace of AI development and the risks of systems becoming harder to understand or control.
AI Development Benefits
Slower Development and Oversight
Pace of development
AI Development Benefits
Using AI to build future AI could help labs develop more capable systems quickly and conduct more safety testing before release.
Slower Development and Oversight
Anthropic and Dario Amodei said the rapid, exponential pace of progress warrants slowing frontier AI development.
Self-improvement
AI Development Benefits
AI-assisted development may help democratic-country labs remain at the frontier while securing AI’s benefits.
Slower Development and Oversight
If models increasingly build their successors, humans may find the systems more difficult to understand, supervise, or control.
Public transparency
AI Development Benefits
Existing development by frontier labs can continue while information is shared to support safer progress.
Slower Development and Oversight
The public needs more measurements, reporting, and possible government-required risk reports to narrow the information gap with labs.
- Organization
- Anthropic, an AI frontier lab
- Proposal
- Greater transparency in the development of frontier AI models
- Key measurement
- How much AI contributes to building the next version of itself
- Other measurements
- Oversight of AI agents and resources used to develop more capable models
- Policy framework
- Anthropic’s Advanced AI Framework proposes safety rules and possible government-required risk reports
- Main concern
- Self-accelerating AI development could make systems harder for humans to understand or control
- CEO’s position
- Dario Amodei urged slowing development but said AI development did not need to be shut down