aifollow.news
← TrendingLatest development Oct 30 17:30
STORY IN FOCUS

OpenAI, Google, Microsoft and Anthropic say they will adopt a shared AI scraping opt-out signal

The four companies say they will adopt a standard that lets publishers express AI training preferences in a website’s robots.txt file across multiple AI companies, rather than setting them separately. Anthropic standards technical lead Kevin Kelley proposed the “policy token” signal as part of the IETF; it remains a proposal.

1 developments2 reports2 sources

Event developments

Coverage of the same occurrence shares a node; subsequent developments have their own nodes.

OpenAI to honor shared robots.txt signal for AI training preferences

OpenAI says it will honor a shared robots.txt signal to help website operators communicate their AI training preferences to participating providers. The material does not identify those providers.

View source reports · 2 sources · 2 reports
All reports · 2

By original publication time, with each report's bookmarks and feedback preserved.

The Verge AI Machine translation

OpenAI, Google, Microsoft and Anthropic say they will adopt a shared AI scraping opt-out signal

The four companies say they will adopt a standard that lets publishers express AI training preferences in a website’s robots.txt file across multiple AI companies, rather than setting them separately. Anthropic standards technical lead Kevin Kelley proposed the “policy token” signal as part of the IETF; it remains a proposal.