Cloudflare Introduces "Pay-Per-Crawl" Feature to Control AI Web Crawlers

Cloudflare has launched a new "pay-per-crawl" feature to limit the unlimited access of AI web crawlers to website data. This initiative addresses customer feedback indicating that they did not want to grant unlimited access to AI crawlers nor completely block this practice. The feature allows for the control and monetization of data access by AI crawlers.