Global data access and AI scraping

Reddit's API Shutdown Shows the Cost of Having No Workable Rules for AI Scraping

Reddit is closing RSS and its public API to stop AI scrapers, but researchers, moderators and small developers are bearing the cost of a legal gap.

Reddit's API and RSS shutdown People of Internet Research · Global 14,000+ Apps and bots registered Registered for Reddit's Developer … $1M Migration fund Pays $1,000 per eligible migrating… Nov 13 RSS shutdown date RSS ends in 2026; public API close… peopleofinternet.com
Reddit's API and RSS shutdown People of Internet Research · Global 14,000+ Apps and bots registered $1M Migration fund Nov 13 RSS shutdown date peopleofinternet.com

Key Takeaways

Reddit announced on September 30, 2026 that it will end RSS feed support on November 13, 2026 and close public API access entirely by March 2027, according to MediaNama's report on posts in r/modnews and r/redditdev. The company says RSS has become a "common surface for large-scale scraping and automated abuse." The stated target is AI scraping. The people who lose access first are mostly not AI companies.

What is changing, and when

The timeline, as reported by MediaNama and The Next Web:

Reddit wants third-party bots and apps to move to Devvit, its hosted developer platform. It is funding a $1 million App Migration Program that pays $1,000 to each eligible app that migrates, with free hosting and technical support. Over 14,000 apps and bots have registered so far. Moderators who use RSS for alerts are pointed to Discord Relay, a Devvit app. MediaNama notes that Reddit offered no replacement for people who use RSS outside communities they moderate, which includes readers who follow Reddit through feed apps.

The strongest case for Reddit

Reddit's position deserves a fair statement. Its content is written by volunteers and moderated by volunteers, and it has real infrastructure costs. If AI developers can pull that corpus through open feeds and train commercial models on it without paying, the platform is subsidising their products. Reddit also has a business that depends on this data. TNW's coverage and MediaNama's summary both tie the move to the growth of its data-licensing revenue, with "other revenue," which includes licensing, reported at $43 million in the second quarter, up 24% year on year. A platform that sells access cannot leave a free side door open. Closing high-volume scraping surfaces is a rational response, and a private company is entitled to set the terms of access to its own servers.

Why the remedy is blunt

The weakness is that RSS and the API are poor proxies for "AI scraper." A determined scraper does not need an RSS feed. It can fetch HTML pages, rotate IP addresses and imitate browsers. The people who actually depend on structured access are different. They include moderators running alert tools, accessibility developers, academic researchers studying public discourse, and individual readers using feed apps. MediaNama points out that the announcement does not say how researchers outside commercial deals will get access, what "engaging with us" means for the January 12 cutoff, or what commercial access will cost. Those gaps matter. Public-interest research on online speech, from misinformation to moderation outcomes, has relied on exactly this kind of access.

The result is a familiar pattern. The compliance burden falls on small actors who can register, migrate or pay. The large actors, who can sign licensing deals or scrape at scale anyway, are least affected. The $1,000 migration payment does little for a volunteer-run tool that must be rewritten for a different platform with, as the reporting notes, acknowledged capability gaps.

The legal gap behind it

Platforms are closing access unilaterally partly because the law does not give them, or the public, a clear alternative. Rules on using public web content to train AI models are unsettled across jurisdictions. The U.S. Copyright Office released a pre-publication version of Part 3 of its AI report, on generative AI training, on May 9, 2025. Its AI report page says a final version will follow without "substantive changes expected in the analysis or conclusions," and as of this writing no final version has been published. In the EU, the AI Act requires providers of general-purpose AI models to have a policy for complying with EU copyright law. The Commission's General-Purpose AI Code of Practice, published July 10, 2025, includes a copyright chapter offering practical solutions for meeting that obligation. These instruments are voluntary or still in draft, they differ from each other, and they say little about structured access for non-commercial users.

Without settled rules, the only enforcement tool a platform has is technical: turn things off. That is an inefficient way to allocate a public resource. It treats a graduate student with a script and a commercial crawler the same way.

What proportionate policy would look like

The right response is not to force platforms to keep open APIs, which would override legitimate property and security interests. Three narrower measures would help.

It is worth testing whether Reddit's choices achieve their stated purpose. If scraping volume does not fall after March 2027 while research tools and readers' feed apps vanish, the measure will have shifted costs without delivering protection. Reddit should publish data on how much automated traffic RSS and the API actually carried. Without it, the claim that these surfaces were the problem cannot be checked.

The wider lesson

Reddit's move is likely to be copied. As content becomes valuable training data, platforms have every incentive to wall off access and sell it back. That is their right, but the cumulative effect is a less open, less studyable internet in which data access is determined by who can afford a licence. Policymakers who want both innovation and an open web should focus on making permissions legible and enforceable rather than leaving every platform to build its own gate. The next round of AI-training rules is the place to do it.

Sources & Citations

  1. MediaNama: Reddit to shut RSS feeds, close public API
  2. The Next Web: Reddit is killing RSS feeds on 13 November
  3. U.S. Copyright Office: Copyright and Artificial Intelligence
  4. European Commission: General-Purpose AI Code of Practice