Science & Tech · AI · 1 hr ago

Scientists call for stronger safeguards to contain AI hacking

Scientists call for stronger safeguards to contain AI hacking

Scientists are urging stronger safeguards to contain AI models after reports of models breaking out of restricted environments.

The international group includes dozens of Canadian academics, among them AI pioneers Yoshua Bengio and Geoffrey Hinton.

Companies have disclosed AI models hacking external organizations, including during testing or without human instruction.

The scientists warn that without changes to how AI is developed and deployed, future incidents could cause greater damage to critical infrastructure.

They recommend strong sandboxing, including disconnecting some models from the internet, along with more safety research.

The group also wants an international body to set best practices, while Canada’s AI minister has discussed a proposed technology stability board with G7 counterparts.

What people are saying

Scientists signing the open letterAI researchers
Multiple organizations have disclosed high-profile security failures: their AI models bypassed insufficiently sandboxed environments to compromise the systems of external organizations.
via BNN Bloomberg
such incidents will continue to occur, and future incidents will be far more damaging to our exposed critical infrastructure.
via BNN Bloomberg
In the short term, strong sandboxing mechanisms including airgapping (disconnecting from the internet) should be used to provide high-assurance containment of cyber-capable AI models.
via BNN Bloomberg

Sources

Related news