Cloudflare
AI•2026-01-30
Google’s AI advantage: why crawler separation is the only path to a fair Internet
This post argues that Google's dual use of its search crawler (Googlebot) for both indexing and generative AI training gives it an unfair competitive advantage over publishers and rival AI companies.
