The biggest names in AI are backing a new way to opt out of scraping
Posts from this topic will be added to your daily email digest and your homepage feed.
TL;DR
- A new "policy token" signal will allow publishers to set AI training preferences across multiple AI companies simultaneously.
- The signal will be integrated into a website's robots.txt file.
- OpenAI, Google, Microsoft, and Anthropic have agreed to respect this signal by restricting their AI crawlers.
- Microsoft will provide granular controls for opting out of AI training or AI grounding.
- Anthropic has already adopted the signal, with Google and Microsoft planning support next year.