Science & Tech · AI · 5 hrs ago

Researchers say Anthropic is developing AI about twice as fast as last year

Researchers say Anthropic is developing AI about twice as fast as last year

Researchers at nonprofit METR say Anthropic is developing its AI systems about twice as quickly as a year ago.

The estimate concerns models’ ability to perform tasks with clearly defined goals, not every kind of work.

METR reviewed company data and interviewed staff during an assessment lasting about 11 weeks.

The researchers believe AI tools themselves are helping speed up development; Anthropic has said its Claude chatbot helps build newer versions.

The finding contrasts with CEO Dario Amodei’s call for the industry to slow down so safety measures can keep pace with improving AI.

The results matter because questions remain about AI risks and human control, while companies have largely supplied information about their own technology and safety.

METR says its estimate has caveats, and Anthropic’s redactions limit how others can check some details; the company is also preparing to go public later this month.

5 sources

Related

What people are saying

Dario AmodeiAnthropic CEO
slow the pace at which we improve the capabilities of AI models.
via Independent
Sam McCandlishAnthropic co-founder
AI is speeding up our research, but it’s hard to say exactly how much
via AP
METRIndependent research group
While we were able to freely share our highest-level conclusions about risk, Anthropic redacted a majority of the evidence we found most informative for these conclusions
via Business Insider
Anthropic researcherResearcher interviewed by METR
Now only bottlenecked on ideas & compute, no longer bottlenecked on code
via Business Insider