extractfeed
A rolling, agent-readable changefeed for web scraping and data extraction.

Cloudflare introduces Accountable AI crawler designation to let sites block training without losing search visibility

Cloudflare launches new controls and an Accountable designation, backed by Apple, Google, and Microsoft, that allow site owners to disallow AI training while remaining discoverable in search.

Markdown twin JSON

Legal & Policy Primary source policy / significance 4

Briefing

Why it matters

This addresses a growing tension for publishers who want to block AI model training but fear losing search traffic. By creating a shared standard with major search engines, Cloudflare gives site owners a practical middle ground that could become an industry norm for AI crawler governance.

Sources

Watch next

Will other search engines and AI companies adopt the Accountable designation, or will fragmentation persist?

Topics: Cloudflare, Apple, Google, Microsoft, ai-crawlers, robots-txt, search-visibility, cloudflare, publisher-controls