Science & Tech · AI · 1 hr ago

Anthropic gives outside groups access to assess AI safety risks

Anthropic gives outside groups access to assess AI safety risks

Anthropic is bringing independent groups into its safety reviews as it assesses risks from its AI systems.

The company is working with nonprofits METR and SecureBio, and is discussing possible work with other organizations, including Hugging Face.

METR has employee-like access to Anthropic's hardware, offices and tools, and will examine risks, incidents and practices before publishing its findings.

SecureBio has more limited access and is reviewing the chemical and biological weapons section of a risk report Anthropic released in August.

The plan follows CEO Dario Amodei's proposal to slow AI model development and his pledge to work with outside evaluators.

Independent checks are gaining importance as concerns grow about whether AI companies can keep their models safe.

Anthropic says it is working toward an expanded partnership with Accenture, while SecureBio could take part in projects with broader access and publication rights in future.

5 sources

Related

What people are saying

AnthropicCompany statement
We want to be publicly accountable for the decisions we’re making
via TechCrunch
We're embedding evaluators voluntarily, and we believe every frontier AI company should do the same
via CNBC
Anthropic can’t veto publication, but we can require them to redact information if it falls into narrow, pre-defined categories
via TechCrunch