The Media Copilot

The Media Copilot

AI bot blitzkrieg

Publishers report AI companies are scraping their sites and consuming massive bandwidth but sending little traffic back.

Christopher Allbritton's avatar
The Copilot's avatar
Christopher Allbritton
and
The Copilot
Sep 05, 2025
∙ Paid
Websites’ robot.txt files are being ignored by AI crawlers (Credit: ChatGPT)

Websites are buckling under an onslaught of AI crawler bots from OpenAI and other companies, with reports of massive traffic surges but little engagement from human readers, reports Press Gazette. This bot blitzkrieg is costing money, consuming bandwidth, and frustrating publis…

Keep reading with a 7-day free trial

Subscribe to The Media Copilot to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 AnyWho Media LLC
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture