Cloudflare to Block Mixed-Use Crawlers from Ad Pages Starting September 15

Key Facts

1Cloudflare announced it will block mixed-use crawlers from ad-supported pages starting September 15, 2026.

In a move that could reshape the relationship between AI companies and publishers, Cloudflare announced it will block mixed-use crawlers from accessing ad-supported pages, according to reports. The company said the new default settings take effect September 15, 2026, and aim to separate search crawlers from those used for AI training. The policy is designed to push AI companies to compensate publishers for their content.

The decision comes amid growing tensions between content publishers and big tech firms over the use of data for AI training. An analysis by EL7 noted the policy could create new revenue opportunities for Cloudflare by offering premium services to publishers, but may also create friction with AI companies. Investors are watching for the policy's impact on Cloudflare's revenue growth, with third-quarter results expected later this year.