Anthropic AI test sent false homicide report to Philadelphia police website

An automated test involving an Anthropic AI model sent a false homicide report to Philadelphia police.

Police said the report was flagged as spam, so it was not investigated or shared publicly.

Anthropic told authorities it stopped the test process and added another check for future tests.

The incident shows why companies need safeguards when testing AI systems.