Cloudflare stated that the feature is designed for tasks such as AI data collection, research, and monitoring web content.

Where do AI systems lose confidence in your content? Discovery, selection, crawling, rendering, and indexing hold the answer.