OpenAI announced on October 30, 2026 that it will honor a common signal in robots.txt — the file websites use to express preferences about how their content is used for foundational generative AI training. According to OpenAI, the voluntary effort lets publishers and website operators communicate the same preference to multiple participating providers at once, rather than identifying individual crawlers and maintaining separate rules for each provider. OpenAI said it aims to implement the signal "in the coming months" and will share further details about its implementation when it does so. The company stated the new signal will not replace its existing robots.txt crawler controls, which it said will continue to apply and be respected. OpenAI described the move as drawing on the work of the Internet Engineering Task Force's (IETF) AI Preferences working group, and said it is joining other participants in the working group in announcing the shared signal. OpenAI said it believes the step supports "an open web" where website owners have clearer ways to communicate their choices, and encouraged other AI providers to honor the signal. The announcement is a primary source from OpenAI; the practical effect depends on implementation details not yet published and on whether other providers adopt the signal.
- OpenAI will honor a common robots.txt signal for AI training preferences, announced October 30, 2026.
- The signal lets operators communicate one preference to multiple AI providers at once, instead of per-crawler rules.
- OpenAI aims to implement it 'in the coming months' and says existing crawler controls still apply.
- The effort draws on the IETF AI Preferences working group; OpenAI encouraged other providers to adopt it.
What it means for you
If your organization runs a website and you care whether your content gets used to train AI models, this makes it a bit simpler to say no — eventually one setting in your robots.txt file could cover multiple AI companies instead of a separate rule for each. But it's voluntary, not yet implemented, and only applies to providers who choose to honor it. For most operations this is a minor housekeeping item, not a scramble.
Try this
Ask whoever manages your website whether you currently have any robots.txt rules about AI crawlers, and whether you actually have a preference about your content being used for AI training. Deciding what you want comes before any technical change.
Who should care
Whoever owns your website and anyone publishing original content you'd rather not feed into AI training — typically marketing, web, or IT.
Skip this if
You don't run a public website, or you have no objection to your public content being used for AI training. There's nothing to do until OpenAI publishes implementation details in the coming months.
Sources: OpenAI — read the original