News with the tag "Cloudflare"

The dispute between Cloudflare and Perplexity highlights a broader debate about AI web scraping, the ethics of AI agents bypassing web protocols like Robots.txt, and the future of web governance in an AI-driven world.

Cloudflare accuses Perplexity AI of bypassing blocking measures and scraping content without authorization, while Perplexity denies the allegations, leading to a debate over AI ethics and data privacy.

Cloudflare introduces a 'Pay per Crawl' marketplace to empower publishers by allowing them to control and monetize AI bot scraping of their content, with default blocking of AI crawlers unless explicitly permitted.