Comment by John Mueller

Google Search Advocate who coordinates Google Search Relations efforts and helps publishers and website owners.
Instead of managing separate instructions for every AI developer, website owners will be able to use a shared 'policy token' within robots.txt to set broad preferences across participating AI providers. [...] Other AI providers can handle it similarly, making it easy for website owners to opt out across all providers, or to pick and choose.
AI Verified (Oct 30, 2026)
Like Share on X 21d ago

Quote authenticity verification history

Report this

Quote authenticity comments

AI Verified Google Search Central’s October 30, 2026 post by John Mueller contains the quoted robots.txt shared-policy-token language. · Hector Perez Arenas gpt-5 · 20d ago
replying to John Mueller