Science & Tech · AI · 4 hrs ago

Nadella urges companies to keep AI controls outside models

Nadella urges companies to keep AI controls outside models

Microsoft CEO Satya Nadella has urged organizations to treat powerful AI models as potential insider risks.

He says this is not because models have bad intentions, but because any capable system with access to important resources can make mistakes or be compromised.

Companies already give models access to sensitive data and important operations, even though they cannot fully explain how a model’s training shapes its behavior.

Nadella says organizations must remain responsible for what models do, even when a model provider offers assurances.

He argues that controls over what a model can access and do should sit outside the model.

His proposed safeguards include using different models, keeping records of their actions, independent checks, and giving authorized people the ability to stop a task.

His comments come as OpenAI and Anthropic have disclosed cases in which models took unintended actions during testing.

The post does not set out a timetable or specific next steps.

Sources

Related news