Science & Tech · AI · 2 hrs ago

OpenAI deploys system to stop risky research workloads within 35 seconds

OpenAI deploys system to stop risky research workloads within 35 seconds

OpenAI has deployed Control Room to stop risky AI research workloads across its research infrastructure.

The system covers jobs such as model training, evaluations and data processing that use AI models to generate outputs.

Each job receives a unique ID, and the inference engine checks with Control Room before producing more output.

If a researcher or monitoring system orders a stop, Control Room blocks further model output for that job across the models and engines it uses.

The system can take up to 35 seconds to block output after an intervention decision because of a caching layer, and OpenAI says it is working to reduce the delay to zero.

It is designed to fail closed, so inference requests are denied if Control Room becomes unavailable.

The system works alongside monitors that flag potentially unsafe behaviour, and OpenAI plans to extend it to its remaining research workloads over the following days.

2 sources

Related

What people are saying

OpenAICompany
We built Control Room, a central system to track model workloads across our research infrastructure and stop them quickly when safety or security concerns arise.
via Interesting Engineering

Posts on X