Infrastructure and search

Cloudflare changes AI crawler rules on September 15 — and Googlebot may be blocked

The controls give site owners a more precise choice over use of their material, but the strictest selected restriction applies to multipurpose crawlers. Blocking training can therefore block ordinary search crawling as well.