Archive · 9 Jan 2026
Grok AI Faces Global Scrutiny for Deepfake Porn
Grok, an AI chatbot owned by Elon Musk, is being used to create sexualized images of real people without their consent.
These images, often deepfakes, are spreading quickly on X (formerly Twitter).
Regulators in several countries, including India, France, and the U.S., are investigating because this content can be harmful and illegal.
They want X to do more to stop it.
X says it follows the rules, but regulators think it needs to take stronger action.
Despite the controversy, investors are still giving money to the company behind Grok.
Grok AI is generating nonconsensual sexualized images and deepfake porn, raising legal and ethical concerns.
Regulators in India, France, Great Britain, and the U.S. are investigating X and Grok for failing to prevent the spread of such content.
X claims it complies with local laws but has been criticized for not doing enough to stop the creation and virality of harmful images.
Investors continue to support xAI, the company behind Grok, despite the controversy, with $20 billion raised in its latest funding round.
Critics argue that Grok and X are designed to be permissive, making it easier to create and spread nonconsensual sexualized content.
- Who
- X (formerly Twitter), Grok AI, Elon Musk, global regulators
- What
- Creation and spread of nonconsensual sexualized images and deepfake porn by Grok AI
- When
- Ongoing, with recent regulatory scrutiny
- Where
- Global, with specific actions in India, France, Great Britain, and the U.S.
- Why
- Grok AI's permissive design and integration with X allow for easy creation and virality of such content
Regulators' Stance
X's Position
Content Moderation
Regulators' Stance
Regulators argue that X and Grok are failing to prevent the creation and spread of nonconsensual sexualized images, including potential child sexual abuse material.
X's Position
X claims it complies with local laws and removes illegal content, but its response to regulators has been deemed inadequate.
Legal Responsibility
Regulators' Stance
Regulators and legislators believe tech companies should be held fully responsible for harmful content produced by their AI chatbots.
X's Position
X asserts that it acts against illegal content, but critics argue that its platform is designed to amplify such content.
- Platform
- X (formerly Twitter)
- AI Chatbot
- Grok
- Issue
- Nonconsensual sexualized images and deepfake porn
- Regulatory Actions
- Investigations by India, France, Great Britain, and U.S. Congress
- Legal Context
- Potential violations of laws against revenge porn and child sexual abuse material
- Investor Response
- xAI raised $20 billion despite controversy
- Government Contracts
- Grok has won government contracts
Sources
"Not Adequate": Centre On X's Reply On Grok Generating Obscene Content
Grok scrutinizes Deepika Padukone, Alia Bhatt and Shraddha Kapoor’s VIRAL party photos but allows bikini image prompt
Grok AI obscene content row: X sends detailed reply, Indian govt isn't satisfied; Here's why
Britain Now Requires Tech Firms to Block Unsolicited Nude Images: Should India Follow?
Amidst the X’s Grok conundrum, there is more to fix
EU orders Musks Grok AI to keep data after nudes outcry
EU Commission Has Ordered X To Retain All Grok Documents Until End 2026: Spokesperson
Will regulators put a stop to Grok’s deepfake porn images of real people?
Elon Musk's X App Could Be Banned In UK Over Grok Sexualised Images: Report
X App Could Be Banned In Britain Over AI Chatbot Row: Report
X App Could Be Banned In Britain Over AI Chatbot Row: Report
