Archive · 10 Aug 2025
Roblox to Open-Source AI to Combat Child Predators
Roblox, a popular online game, is sharing its AI system called Sentinel to help keep kids safe.
This system looks for bad things like grooming or abuse in chat messages.
It watches what people say over time, not just one message.
The system flags risky conversations for human review, who then report to the police if needed.
This helps Roblox and other platforms identify and prevent predators from harming children.
The goal is to protect kids by spotting dangerous behavior early on.
Roblox is releasing an open-source AI system, Sentinel, to detect predatory language in game chats.
The system aims to identify potential child endangerment through analysis of chat interactions.
Roblox faces lawsuits alleging inadequate protection of children from predators on its platform.
Sentinel analyzes approximately 6 billion messages daily, evaluating them for harmful patterns.
Humans review risky interactions identified by the AI and report to law enforcement.
- Who
- Roblox, an online gaming platform, is using the AI system, Sentinel, to protect children.
- What
- Roblox is releasing an open-source AI system, Sentinel, to detect predatory language in game chats and protect children.
- When
- In the first half of 2025, the system submitted 1,200 reports of potential attempts at child exploitation.
- Where
- The AI system operates on the Roblox platform.
- Why
- To proactively identify and prevent child endangerment and predatory behavior on the platform.
Plaintiffs
Roblox
Platform Safety
Plaintiffs
Roblox's design features make children vulnerable to predators.
Roblox
Roblox is working to improve its platform safety features to protect children, including releasing Sentinel.
- Platform
- Roblox
- System Name
- Sentinel
- Function
- Detects predatory language and child endangerment
- Monthly Users
- Over 111 million
- Messages Analyzed Daily
- Approximately 6 billion
- Reports in H1 2025
- 1,200 potential child exploitation attempts