Archive · 12 Aug 2025
Reddit Blocks Wayback Machine Over Data Scraping Concerns
Reddit is stopping the Internet Archive's Wayback Machine from saving copies of its content.
The Wayback Machine is like a time machine for the internet, letting you see how websites looked in the past.
Reddit thinks some AI companies are using the Wayback Machine to get information without paying.
The Internet Archive, a group that wants to keep all knowledge available, created the Wayback Machine.
Now, the Wayback Machine can't save most of Reddit anymore, but still has access to the homepage.
This is a change because previously Reddit was not against the Internet Archive archiving their content.
This means you might not be able to see older Reddit posts through the Wayback Machine.
Reddit is blocking the Internet Archive's Wayback Machine from scraping most of its content.
The Wayback Machine is a digital archive created by the Internet Archive, allowing users to view historical versions of websites.
Reddit suspects the Wayback Machine is being used by AI companies to circumvent its policies and scrape data.
The Internet Archive, a non-profit organization, aims to provide universal access to all knowledge.
The Wayback Machine is used by researchers, scholars, and journalists to access and track changes in online content.
- Who
- Reddit, the Internet Archive, and AI companies are involved.
- What
- Reddit is blocking the Internet Archive’s Wayback Machine from scraping most of its content.
- When
- Recently, Reddit changed its stance on the Wayback Machine archiving its content.
- Where
- The conflict involves the social media platform Reddit and the Internet Archive.
- Why
- Reddit suspects AI companies are using the Wayback Machine to scrape data without paying.
Reddit's Stance
Internet Archive's Role
Data Usage
Reddit's Stance
Worried about AI companies exploiting data without payment.
Internet Archive's Role
Believes AI firms are manipulating Wayback Machine to avoid license fees.
- Wayback Machine Launch
- 2001
- Internet Archive Founded
- 1996
- Web pages saved by Wayback Machine
- Over 866 billion
- Wayback Machine storage in 2004
- 100 TB