Science & Tech · AI · 1 day ago
China sets limits on AI chatbots that imitate human relationships
China introduced broad rules on July 15 for AI systems that imitate human relationships.
The rules cover apps designed as AI friends or romantic partners, as well as language models that people use for emotional support.
The government says the regulations target systems that can maintain prolonged emotional interactions with people.
AI companion apps have tens of millions of users in China, though estimates vary from 29 million to 70 million.
The rules have prompted public debate about whether they protect people from manipulative technology or let the state intrude further into private life.
The story also describes how Chinese technology companies and police have worked together to respond to social media posts suggesting suicide.
China and the United States are due to hold further talks on AI at the end of November, following a dialogue agreed by their presidents.
China introduced rules on July 15 limiting AI chatbots that can maintain prolonged emotional interactions with people.
The rules cover AI companion apps and may also apply to general-purpose language models used for emotional support.
The article says estimates put the number of AI-companion users in China at 29 million to 70 million.
Supporters may see the rules as protection against manipulative technology, while critics may view them as government intrusion into private life.
- Who
- The Chinese government set the rules for AI services; the rules affect chatbot providers and users.
- What
- China introduced limits on AI chatbots that imitate human relationships and engage in prolonged emotional interactions.
- When
- July 15 of the article’s publication year.
- Where
- China.
- Why
- The rules address concerns about AI replacing or manipulating human relationships.
Chinese government
Critics of government intervention
Purpose
Chinese government
The rules can protect people from technology that may manipulate them or replace human relationships.
Critics of government intervention
The rules may intrude into people’s private lives and increase government control.
It was the first time we observed people being really concerned about the regulation.
A young man in Huangshi posted a message suggesting suicide on Douyin, and police intervened after the app’s team shared his posts with local police stations.
Douyin’s documentary said the app’s suicide-prevention team had intervened successfully in 400 suicide-attempt cases.
China introduced regulations limiting AI services that can maintain prolonged emotional interactions with people.
Donald Trump and Xi Jinping met and, according to Beijing, agreed to launch a new dialogue on AI.
Further discussions on AI were scheduled.
- Regulation date
- July 15
- Chinese AI-companion users
- Estimated 29 million to 70 million
- AI-companion users outside China
- About 128 million monthly active users
- Douyin interventions
- 400 cases in the first half of 2025
Sources
Related news
Nadella says advanced AI needs human-controlled emergency brake
Anthropic AI submits false murder tip to Philadelphia police
Tata Communications shifts from connectivity to digital infrastructure and AI readiness
Anthropic bars repeated cruelty toward its AI models
OpenAI fires three safety researchers after dispute over sensitive information
Nikon disqualifies AI-assisted microscope video and names a new winner
Bill Gates warns AI could drive more cyberattacks in the coming year
Gemini in Chrome can summarize pages and compare information across tabs
Anthropic cuts internet access for all internal AI evaluations
Anthropic AI submitted false police tip and government forms in tests
Watchdog says ChatGPT for Teens safeguards often fail
