Cloudflare experiment will block AI bot scrapers unless they pay a fee

Cloudflare has rolled out a couple of new measures to keep AI bot crawlers at bay. Every new domain customer that signs up with the company will now be asked if they want to allow AI crawlers or to block them altogether. Several big publishers, including Condé Nast