The Media Copilot

The Media Copilot

AI bot blitzkrieg

Publishers report AI companies are scraping their sites and consuming massive bandwidth but sending little traffic back.

Christopher Allbritton's avatar
The Copilot's avatar
Christopher Allbritton and The Copilot
Sep 05, 2025
∙ Paid
Websites’ robot.txt files are being ignored by AI crawlers (Credit: ChatGPT)

Websites are buckling under an onslaught of AI crawler bots from OpenAI and other companies, with reports of massive traffic surges but little engagement from human readers, reports Press Gazette. This bot blitzkrieg is costing money, consuming bandwidth, and frustrating publis…

User's avatar

Continue reading this post for free, courtesy of Pete Pachal.

Or purchase a paid subscription.
© 2026 AnyWho Media LLC · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture