Follow the latest coverage, related explainers and connected technology stories.
Cloudflare announced Bot Preference Sync, a feature that automatically updates robots.txt according to site settings for search, agent, and training bots. The feature will be available to all customers, from the Free plan to Enterprise, while retaining the option to disable synchronization.