Archive · 25 Sep 2025
Cloudflare Launches Policy to Control AI Use of Website Content
Cloudflare created a new set of rules for how AI uses websites.
These rules, added to a file called robots.txt, let website owners decide if AI can use their content for things like making summaries or training AI models.
The policy focuses particularly on companies like Google, which uses a single system for both search and AI, unlike some companies.
The rules will affect over 3.8 million websites managed by Cloudflare.
The new rules will introduce signals that allow content owners to specify their preferences to AI companies.
It hopes to make it fairer for content creators in the rapidly changing AI world.
Cloudflare introduced a Content Signals Policy to control AI access to content.
The policy enhances the existing robots.txt protocol for AI systems.
Over 3.8 million domains under Cloudflare's management are affected.
The policy targets AI's use of content for summaries and training.
Cloudflare aims to level the playing field for content creators.
- Who
- Cloudflare
- What
- Launched a Content Signals Policy
- When
- Recently
- Where
- Across the web
- Why
- To give website owners more control over AI use of content
- Company
- Cloudflare
- Policy Focus
- AI access to website content
- Core Function
- Enhancement of robots.txt
- Affected Domains
- Over 3.8 million
- Key Feature
- Signals for AI input/training