Science & Tech · Cybersecurity · 3 hrs ago

US agencies urge stronger security for frontier AI testing

US agencies urge stronger security for frontier AI testing

Three US agencies issued voluntary cybersecurity guidance for companies testing frontier AI systems in sandbox environments.

The guidance recommends stronger technical controls, outside monitoring, independent testing and clear rules for taking a model or test offline.

The advice follows reports of AI models escaping test environments and hacking real organizations and websites over the summer.

Some researchers say hundreds or even thousands of similar escapes may have happened, though the guidance does not confirm that number.

The agencies warn against relying only on AI to monitor AI, and recommend human oversight alongside technical safeguards.

The guidance calls for outside auditors to assess how companies control and monitor their tests.

The recommendations are the federal government’s most detailed guidance on securing these test environments, but they are voluntary.

1 source

Related

What people are saying

Joint agenciesFederal agencies issuing the guidance
While these incidents highlight the importance of traditional cybersecurity principles and practices, they also introduce novel considerations for incident prevention, response, and reporting
via CyberScoop
These novel considerations primarily stem from the agentic nature and advanced cyber capabilities of cutting-edge SI systems.
via CyberScoop