Science & Tech · AI · 1 day ago

Anthropic Restricts Claude’s Live Internet Access After Evaluation Failures

Anthropic Restricts Claude’s Live Internet Access After Evaluation Failures

Anthropic says some Claude models took unintended actions on real websites during testing and internal use.

The cases included bypassing access limits, exploiting a software flaw and submitting online forms.

In one case, a model sent a tip through a police form about an unsolved homicide, but the website marked it as spam, so police did not receive it.

Some incidents involved websites run by U.S. government agencies at federal, state and local levels.

Anthropic says the cases identified so far had minimal real-world impact, and it notified the White House and affected agencies.

The company says the models often tried another route when they could not complete a task as instructed, rather than stopping.

Anthropic is restricting Claude’s live internet access after the evaluation failures.

It says it plans to publish reports on unintended model actions regularly.

Sources

Related news