1 day ago
AI Summaries Threaten Website Traffic and the Web’s Social Contract
For many years, websites let search engines read their pages in exchange for visitors and links.
AI tools now often read websites to learn from them and create answers.
These answers may include links, but the links are not always the main part of the response.
This can mean fewer people visit the original websites.
Website owners may then block AI tools from reading their content.
If that happens, AI systems may have fewer reliable sources to use.
Researchers also warn that low-quality or AI-generated pages could become more important.
The change is creating disagreements about who should receive credit and money for online information.
Two University of Melbourne researchers examined how AI is changing web traffic and information access.
AI tools increasingly crawl websites to train models and generate answers rather than primarily linking to sources.
As websites lose traffic and revenue, some owners are blocking AI scraping tools.
Researchers warn this could make AI systems more dependent on low-quality or AI-generated websites.
The shift has intensified disputes over revenue sharing, data use, attribution, and intellectual property.
- Who
- Two University of Melbourne researchers, website owners, AI companies, search engines, content creators, and governments are involved in the debate.
- What
- AI crawling and summarization may be reducing direct website traffic while creating disputes over scraping, attribution, revenue, and intellectual property.
- Where
- The issue concerns the worldwide web and online services including ChatGPT and Google’s AI Overviews.
- When
- The researchers describe a recent shift after roughly 30 years of the web’s established search-and-linking arrangement.
- Why
- AI systems use website content to train models and generate answers, potentially reducing visits, advertising revenue, and recognition for original creators.
AI Access and Convenient Answers
Creator Rights and Direct Traffic
Use of online content
AI Access and Convenient Answers
AI companies and search services use website content to provide quick answers, sometimes including links to sources.
Creator Rights and Direct Traffic
Website owners and content creators argue that using their work without meaningful credit, payment, or visits undermines the web’s established arrangement.
Blocking AI crawlers
AI Access and Convenient Answers
Open access to websites can give AI systems more information to train on and potentially improve their answers.
Creator Rights and Direct Traffic
Owners are increasingly blocking AI scraping tools to protect traffic and revenue, though researchers warn this could leave AI systems more dependent on lower-quality sources.
Search and information discovery
AI Access and Convenient Answers
AI summaries make information faster and more convenient for people who do not need to conduct extensive web searches.
Creator Rights and Direct Traffic
Critics say summaries can discourage deeper research, reduce traffic to original sites, and make high-quality information harder to find.
Key facts
- Researchers
- Two researchers from the University of Melbourne
- Traditional web arrangement
- Websites generally allowed search engines to access content in exchange for links and credit.
- AI use of websites
- AI tools crawl sites to train models and generate answers, which may not prominently link to sources.
- Effect on website owners
- Reduced traffic can mean reduced revenue, prompting some owners to block AI scraping tools.
- Potential information-quality risk
- AI systems could rely more on low-quality websites, including pages generated by AI.
- Main disputes
- Revenue sharing, data use, attribution, and intellectual property rights
Quotes
Two Melbourne University researchers
Researchers whose study examines AI’s effects on websites and the web’s information ecosystem.
“For 30 years, the worldwide web (www) has run on a surprisingly profound social contract: most sites are free for search engines to access, but if you use their content, you give credit by linking to the source. Recently, that social contract has started collapsing.”
thehansindia.com
“Artificial intelligence tools are crawling sites not to link to them, but to train models and generate answers that may or may not be accurate.”
thehansindia.com
Sources
Related news
AI Crawlers Threaten Web Quality as Traffic and Trust Collapse
Readers Debate AI Content Rights and National Identity
Google's AI Search Cuts Publisher Traffic, Draws Global Regulatory Backlash
Regulators Scrutinise Google's AI Search Treatment of Publishers
French Media Groups Accuse Google AI Summaries of Cutting Traffic
Tech Giants Move to Clean Up AI Slop Across Platforms
Former Big Tech Workers Describe Layoffs’ Harsh Aftermath
Sorrell Sees Digital Spending Dominating Global Advertising
Former Google Engineer Sentenced for Stealing China AI Secrets
Google launches AI-powered Pics design tool for everyday creators
Ajay Banga Says India’s Development Offers Global Lessons
