Science & Tech · AI · 3 hrs ago

Cisco releases open-source tool to monitor AI agent behavior

Cisco releases open-source tool to monitor AI agent behavior

Cisco has released Project Quarry, an open-source tool for monitoring AI agents.

The tool is designed to help security teams detect when AI agents take unauthorized actions.

Instead of judging each action on its own, Quarry examines the full sequence of actions in an agent session.

For example, reading a sensitive file may be legitimate, but sending its contents to an outside server afterward could signal data theft.

Quarry supports AI conversations, tool use and interactions through the Model Context Protocol, and lets teams write rules to flag suspicious patterns.

Cisco says the project is not a replacement for human oversight, but can help people investigate potential threats.

Its code repository includes setup instructions, plugins and guidance for writing detection rules.

3 sources

Related

What people are saying

Amy ChangCisco head of AI threat and security research
But what is missing is the entire context under which something may occur.
via The Register
One tool call may seem in-scope until you realize that that next step is taking that information and sending it to an attacker-controlled inbox or server.
via The Register