When your audience is mostly bots
AI bots have officially outnumbered human visitors online. Plus: the EU's new AI content transparency code.
Bot traffic has officially crossed a major threshold: automated scrapers now outnumber human readers on the web. This week's column explains what that means for publishers, and if there are any good paths to monetization outside of licensing.
Reminder that AI for Media—our 6-week AI training program for journalists, PR professionals, and communicators starts in two weeks! Book your spot now.
A MESSAGE FROM ADOBE
The new Adobe productivity agent orchestrates tools and models to generate images, text and rich content like presentations, podcasts and social posts, while also powering conversational PDF editing in Acrobat.
With new PDF Spaces capabilities, users can combine files, links and notes into interactive, shareable spaces for research, collaboration and content creation. VICE News, Kid Cudi and celebrity event planner Mindy Weiss are already using these tools to build trust and deeper engagement with their audiences.
Learn more: Do that with Acrobat: AI-Powered PDF workspaces | Adobe Acrobat
When bots outnumber people, content becomes a data product
For two decades, the bargain with search engines was simple. Google indexed your site, sent you visitors via a headline and a link, and behaved more like a distributor than a republisher. Although copyright concerns weren't totally muted, media companies generally treated mass indexing as the cost of being on the internet, and they learned to play the game on those terms.
AI search broke the bargain. Answer engines ingest content, summarize it, and merge it with other information relevant to the query to build an answer. That answer often satisfies the user, which is great for the user—and a problem for the publisher whose work fueled it.
The new value lives in the citation
The fact that the user got what they needed, however, underscores the value of the information in the first place, and that value usually shows up right inside the answer as a citation—a named source, with a link. And while the underlying issue has inspired several lawsuits and existential panic in the media industry, there's a growing consensus that what AI does to content has more in common with syndication than distribution.
Consensus is nice. Enforceable consensus is better, and it may have just arrived. The Competition and Markets Authority (CMA), a UK regulatory board, ruled that Google must provide publishers a way to opt out of AI Overviews, the summaries that appear at the top of search results. Up until now, Google used the same bot for search indexing and AI crawling; opt out of one, and you opt out of both. That changes now. Going forward, publishers will be able to choose whether or not to appear, and Google is forbidden from punishing the search rankings of sites that choose AI invisibility.
Yes: One ruling, one regulator, one country, but real leverage, and Google is playing along so far. The company spun the news into a blog post promising publishers "new opportunities with generative AI in search." The phrasing is corporate, but the underlying shift is real. There's now an opening for publishers to show AI systems exactly what their content is worth. They should take it, because AI systems are fast becoming the audience that matters most.
Bots are now most of your audience
The old SEO playbook was a numbers game built on humans. You would publish articles, optimize them for SEO, and rack up clicks. Click-throughs from AI search do show better engagement when they happen, but the volume is a rounding error. TollBit data has logged scrape-to-referral ratios of 179:1 for OpenAI, 369:1 for Perplexity, and 8,692:1 for Anthropic. Digital Trends counted 4.1 million bot scrapes against 4,200 human referrals in a single week.
And the human slice keeps shrinking. Cloudflare CEO Matthew Prince said recently that bot traffic has passed human traffic for the first time, 57.4% of requests versus 42.6%. The crossover came 18 months ahead of his own forecast, with agentic traffic growing eight times faster than human activity.