Science & Tech · AI · 4 hrs ago

Anthropic develops open-source system to verify AI model outputs

Anthropic develops open-source system to verify AI model outputs

Anthropic is developing FlashProve, an open-source system designed to verify which AI model produced a particular answer.

The system would use cryptographic proof to let users check that an output came from the model they were told was being used.

This could help guard against companies secretly switching models, for example to cut costs or make performance results look better.

To use it, AI labs would publish a fingerprint for each model that can be matched to outputs without revealing the model’s private internal numbers.

Anthropic says the system is designed for verification on a local device, and it has released technical details and working code publicly.

Research is ongoing, with no deployment planned, and the team is inviting others to test and improve the system.

1 source

Related

What people are saying

Anthropic researchersResearchers developing FlashProve
This research post is meant to share intermediate progress, and not a completed research agenda
via TechCrunch
We are sharing this explicitly with the goal that others look at what we have done, take it, and improve it.
via TechCrunch