Block AI Training on Your Blog: robots.txt Guide 2026

Can you stop AI companies from training on your blog? On 30 October 2026, OpenAI made that a little easier. It announced it will honor a common signal in robots.txt that lets website owners state their AI training preference once, for every participating AI provider, instead of writing separate rules for each crawler. Short answer: the signal is coming "in the coming months", it's voluntary, and it doesn't replace your existing robots.txt controls. Nothing breaks today, and you have time to decide.

This guide explains what changed, how AI training differs from search indexing, and a simple checklist for bloggers and small site owners. It is based on OpenAI's announcement. This is general information, not legal advice.

What OpenAI announced

Here's what OpenAI said, in plain words:

• OpenAI will honor a common signal in robots.txt that expresses your preference about using your content for "foundational generative AI training".
• The goal is to let you tell multiple participating providers at once, instead of finding every AI crawler's name and writing a rule for each.
• OpenAI aims to implement it "in the coming months" and will publish details later.
• It won't replace OpenAI's existing crawler controls, which "will continue to apply and be respected".
• The work comes from the Internet Engineering Task Force's (IETF) AI Preferences working group. OpenAI says it is joining other participants in announcing the shared signal, and it encourages other AI providers to honor it.

OpenAI's post doesn't spell out the exact syntax, so we won't guess it here. When the format is final, copy it from the official IETF or provider documentation, not from a random blog.

What is robots.txt, quickly?

Robots.txt is a small text file at the root of your site (for example yourblog.com/robots.txt). It tells automated crawlers which parts of the site they may visit. Well-behaved crawlers follow it. It isn't a lock: bad bots can ignore it. For honest, large AI companies, though, it's the main way to state your choices.

On Blogger you can view yours at yourblog.blogspot.com/robots.txt. Blogger also lets you set a custom robots.txt under Settings > Crawlers and indexing. Edit it carefully, because a single wrong line can hide your whole blog from Google.

AI training vs search indexing: they are different

This is the part many bloggers mix up:

• Search indexing means a search engine stores your page so it can show it, and send you visitors, in results.
• AI training means your text is used to help build a new AI model.

The new signal is about training. Blocking AI training should not mean blocking Google Search from indexing you. If you accidentally block Googlebot, your traffic can collapse. Keep search crawlers allowed unless you really want to vanish from search. Our Blogger and Search Console indexing log shows how to confirm Google can still reach your pages.

A related point: Google says its AI features in Search (AI Overviews and AI Mode) have no special requirements, and that being indexed and snippet-eligible is what matters. See our Google AI Mode guide for bloggers.

Should you allow or block AI training?

There's no single right answer. Here are the trade-offs.

Reasons some bloggers block training

• They don't want their original writing reused without payment or credit.
• They sell premium content, courses or guides.
• They want control while laws and licensing deals catch up.

Reasons some bloggers allow it

• They want their brand and ideas to be widely known, including inside AI tools.
• Their content is mostly news commentary or public information.
• They don't want to risk misconfiguring robots.txt.

Whatever you choose, write it down on your site's Privacy or Terms page, so readers and partners know your policy.

A 6-step checklist for bloggers

1. Decide your policy: allow AI training, refuse it, or decide later.
2. Open your current robots.txt and save a copy before changing anything.
3. Keep search crawlers allowed. Make sure nothing blocks Googlebot or Bingbot from your posts.
4. Use existing crawler rules for now if you want to refuse training today. OpenAI says its current crawler controls keep working.
5. Watch for the official syntax from the IETF AI Preferences group and OpenAI's follow-up post.
6. Re-test after every edit. In Google Search Console, use URL Inspection on a few posts to confirm they're still indexable.

Why this matters right now

The announcement came the same week Reddit's CEO said Google's AI Mode "does not drive traffic", as we cover in Reddit vs AI Mode: what bloggers should do. Publishers are rethinking what they give to AI systems and what they get back. A shared signal is a small but real step toward giving site owners clearer choices.

It's also part of a wider safety and trust push. The same day, OpenAI announced a Community Safety Report and stricter limits on some ChatGPT answers. More on the models themselves in our GPT-6 guide.

Quick glossary

• Crawler (bot): a program that automatically visits web pages, like Googlebot for Search or an AI company's crawler.
• Foundational AI training: using large amounts of text to build a new base AI model, as opposed to fetching a page live to answer one question.
• IETF: the Internet Engineering Task Force, the group that writes many of the open standards the web runs on.
• Indexing: a search engine storing your page so it can appear in results.

Want to put this into practice? Try our free Robots TXT Generator and Meta Tag Generator right in your browser, then read Reddit Says AI Mode Kills Traffic and Build Log on Botvana.

Sources and further reading

• Helping websites express AI training preferences (OpenAI)
• Machine-Readable Training Preference Signal (Internet-Draft) (IETF)

Frequently asked questions

Can I stop ChatGPT from training on my website?

You can state your preference in robots.txt. OpenAI says its existing crawler controls are respected, and it will also honor the new common signal once it's implemented in the coming months.

Will blocking AI training hurt my Google ranking?

Not if you only block AI training and keep search crawlers like Googlebot allowed. Blocking Googlebot itself would remove you from search.

Is the new robots.txt AI signal live?

Not yet for OpenAI. It said on 30 October 2026 that it aims to implement it in the coming months and will share details then.

Do all AI companies follow robots.txt?

It's voluntary. OpenAI encourages other providers to honor the shared signal, but some crawlers may ignore it.

The bottom line

You'll soon have one simpler way to say "yes" or "no" to AI training. Don't rush to edit robots.txt tonight. Decide your policy, protect your search visibility, and wait for the official syntax. We'll update this guide when it lands.