OpenAI, Google, Microsoft and Anthropic say they will adopt a shared AI scraping opt-out signal
The four companies say they will adopt a standard that lets publishers express AI training preferences in a website’s robots.txt file across multiple AI companies, rather than setting them separately. Anthropic standards technical lead Kevin Kelley proposed the “policy token” signal as part of the IETF; it remains a proposal.