Cloudflare CEO says the web's future is "pay to crawl" as bots overtake human traffic
Quick Answer
Cloudflare CEO Matthew Prince reports that bot traffic now exceeds human traffic on the internet, accelerated by AI agents.
Quick Take
Cloudflare CEO Matthew Prince reports that bot traffic now exceeds human traffic on the internet, accelerated by AI agents. He predicts a future where accessing web content will require payment, coining the term 'pay to crawl.'
Key Points
- Bot traffic has surpassed human traffic on the internet.
- Matthew Prince attributes the surge to AI agents.
- The prediction for the web's future is 'pay to crawl.'
- This shift could impact content accessibility for users.
- The trend is occurring years ahead of previous forecasts.
Article Excerpt
From source RSS / original summaryBot traffic now outpaces human traffic on the internet, Cloudflare CEO Matthew Prince says, years ahead of his late 2027 forecast. He blames AI agents for the surge. His conclusion for the future of the web: "Clearly it's going to be pay to crawl. " The article Cloudflare CEO says the web's future is "pay to crawl" as bots overtake human traffic appeared first on The Decoder.
Reader Mode unavailable (could not extract clean content).
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from The Decoder
See more →
OpenAI models now available on Amazon Web Services
OpenAI has launched GPT-5.5, GPT-5.4, and Codex on Amazon Bedrock, matching its own pricing. Currently, these models are available only in the US across commercial and government AWS regions, with usage contributing to existing AWS contracts.
