1 week ago

ChatGPT Teen Safeguards Face Questions Among Indian Users

ChatGPT Teen Safeguards Face Questions Among Indian Users
ChatGPT for Teens promises safer AI. Will its safeguards work for Indian users? · indianexpress.com

OpenAI has added extra safety rules for teenagers using ChatGPT.

Teenagers still use the normal ChatGPT service rather than a separate app.

The system tries to work out whether someone is under 18 by examining age information and patterns of account use.

This can be difficult in India because many teenagers use shared devices or accounts.

Tests found that some rules could be weakened when users kept asking the same thing.

Researchers also found that chatbots may miss signs that a young person is experiencing mental-health problems.

Long conversations appeared to be more difficult for safety systems than short, clear questions.

Family controls may also work less well for teenagers who lack private devices or personal email accounts.

Key facts

Service design
The teen experience is built into regular ChatGPT rather than provided through a separate application or website.
Age threshold
OpenAI does not allow children below age 13 to use ChatGPT.
Age detection
OpenAI uses stated or verified age and signals such as account age, usage times, conversation topics and usage patterns.
Shared devices in India
The RATI Foundation study found that 62% of surveyed Indian teenagers used shared devices.
AI access gap
The study said 60% of affluent urban teenagers had experimented with AI tools, compared with 12% of rural low-income teenagers.
Family controls
Parents can link their account to a teenager’s account by email to manage some settings, set quiet hours and receive safety notifications.
Research concern
Common Sense Media and Stanford Medicine found safeguards were less reliable during extended conversations and could miss indirect signs of mental-health distress.

Quotes

Robbie Torney

Head of AI and Digital Assessments at Common Sense

“When conversations get long, the system may fail to include safety instructions from the system prompt given to the model, or the conversation data may begin to resemble unsafe training data”
indianexpress.com
“testing the product that teens are using, not a model in isolation over an API”
indianexpress.com

Sources

Related news