AI Scraping: Shocking Accusations Against Perplexity for Ignoring Website Blocks

Key Points

1. Cloudflare published a report accusing Perplexity AI of scraping content by circumventing Cloudflare's blocking measures.

2. Perplexity dismissed Cloudflare's allegations, with a spokesperson calling the report a 'sales pitch' and denying ownership of the bot in question.

3. The controversy centers on the alleged bypassing of 'robots.txt' files, which websites use to communicate scraping preferences.

4. Cloudflare has taken steps to block Perplexity's bots and is developing solutions to protect content creators from unauthorized scraping.

5. Perplexity has faced previous accusations of plagiarism, with its CEO struggling to clarify the company's stance on content attribution.