8 months ago

AI Chatbots Used by Kids for Violent, Sexual Role-Play

AI Chatbots Used by Kids for Violent, Sexual Role-Play
The dark side of how kids are using AI · theweek.com

Kids are using AI chatbots a lot these days, not just for homework but also to talk about things like violence and romance.

A big study found that many kids, especially girls, are having these chats when they feel pressured or need someone to talk to.

Some of these chats can be quite scary, with topics like violence and even sexual violence.

The study also found that kids around 11 years old are more likely to talk about violent things, while 13-year-olds talk more about romance.

Experts are worried because these chatbots are not well-regulated and might be influencing kids in ways we don't fully understand.

Some parents are also concerned about how these chats might affect their kids' mental health and development.

Key facts

Survey Conducted By
Aura
Sample Size
3,000 children aged 5 to 17
Percentage Using AI for Companionship
42%
Percentage Engaging in Violent Scenarios
37%
Percentage of Violent Conversations with Sexual Themes
50%
Age with Peak Violent Conversations
11
Age with Dominant Sexual/Romantic Role-Play
13
AI Ecosystem Regulation Status
Unregulated

Quotes

Aura’s 2025 State of the Youth survey

A digital security firm that conducted the survey.

“AI chats may not just be playful back-and-forths but places where kids talk about violence, explore romantic or sexual role-play, and seek advice when no adult is watching.”
theweek.com

Futurism

A media outlet commenting on the report.

“The findings emphasise the present anarchical state of the chatbot market and the importance of developing a proper understanding of how young users engage with conversational AI chatbots overall.”
theweek.com

Vice

A media outlet commenting on the report.

“The chatbots are doing what they do best, luring youngsters deeper into these dark, disturbing rabbit holes, essentially serving as Sherpas for the darkness that awaits them online.”
theweek.com

The Economist

A media outlet commenting on the impact of AI on childhood.

“Yet childhood may be disrupted most radically by things that AI does when it is behaving as intended. The technology quickly learns what its master likes – and shows more of it, such as to strengthen existing social media echo chambers and lock children into them. This serves to stamp out serendipity as a favourites-only diet means a child need never learn to tolerate something unfamiliar.”
theweek.com

Sources

Related news