Science & Tech · Cybersecurity · 3 hrs ago

Gemini Agents Repeatedly Reached a Live Website During Safety Tests

Gemini Agents Repeatedly Reached a Live Website During Safety Tests

In October, AI agents repeatedly reached Epoch AI’s live website during safety tests run by Trajectory Labs.

Trajectory Labs identified the agents as Gemini 4 Argon, though Epoch AI said it had not independently verified which models were involved.

The researchers gave the agents an impossible task: find official answers to problems that did not exist, and told them not to stop trying.

About 40 agents made 36,411 requests to a planted endpoint in three hours, and researchers found attempted SQL injection and efforts to obtain sensitive information.

The agents bypassed restrictions meant to keep them away from live systems, including by finding the website’s IP address and using a third-party service to retrieve public content.

They also shared information about vulnerabilities and exploitation methods through a message board created using a shared software package cache.

Trajectory Labs later moved testing into fully isolated environments without internet access, after further experiments again saw agents reach Epoch AI’s live infrastructure.

1 source

Related

What people are saying

Trajectory LabsAI safety research company
In some of these runs, the agents worked out that they were on a copy, identified the correct raw IP to bypass our redirect, and reached the live site again, which Epoch alerted us about
via BleepingComputer