Rightshold™ Sign up

Answers · AI crawlers

Microsoft says NoArchive and NoCache stop counting as AI preferences after March 1, 2027. How do I keep my pages out of Copilot and Bing's AI answers without dropping out of Bing search, and what do the new ai-grounding and ai-training settings actually do?

Last updated

TL;DR: Use Microsoft's new AI Grounding preference, page by page, and leave Bingbot allowed. Microsoft announced on October 30, 2026 that it is splitting AI use of web content into two independent choices. AI Training (whether a page may train generative models) can be set for a site or path in robots.txt with the shared "User-Agent: __usage_ai-training" group, or per page with <meta name="Bingbot" content="ai-training:disallow">. AI Grounding (whether a page may help inform generated answers) is page-level only: <meta name="Bingbot" content="ai-grounding:disallow"> keeps it out of answers, and ai-grounding:disallowextended allows Microsoft's own experiences (AI Mode, AI Overview, Copilot, Microsoft 365) but not the grounding Microsoft sells to third parties through Web IQ and Foundry. Both default to Allow, and Microsoft says neither changes eligibility for ordinary Bing results. They take effect from February 1, 2027 as Bing recrawls. If you rely on NoArchive or NoCache today, publish the new tags and, from December 15, 2026, record a temporary grounding preference in Bing Webmaster Tools before March 1, 2027, or those pages default to Allow until they're recrawled.

What should I check, step by step?

1. Decide training and grounding separately. Microsoft treats them as independent: blocking training doesn't keep a page out of Copilot answers, and blocking grounding doesn't stop training. Neither one is a search setting.

  1. Leave Bingbot allowed in robots.txt. Microsoft says an Allow preference doesn't override a robots.txt rule that blocks Bingbot, and blocking the crawler or adding noindex takes you out of Bing search, which is more than the AI settings ask for.
  2. To keep a page out of AI answers, add <meta name="Bingbot" content="ai-grounding:disallow"> to its head, or send X-Robots-Tag: Bingbot: ai-grounding:disallow as a response header (the header form also covers PDFs and other non-HTML files). There is no site-wide robots.txt grounding setting, so it has to go on every page you want excluded, usually through a template.
  3. If you want to stay in Copilot and Bing's own AI answers but not be fed to other companies' AI apps through Microsoft's grounding services, use ai-grounding:disallowextended instead.
  4. To opt out of training for the whole site, add a group with "User-Agent: __usage_ai-training" and "Disallow: /" (or Disallow lines for specific paths). For one page, use <meta name="Bingbot" content="ai-training:disallow">; Microsoft says the page setting overrides robots.txt.
  5. If your templates carry noarchive or nocache today, map each to what you meant. Under the 2023 rules, NOARCHIVE kept a page out of Chat and Copilot answers and out of training; NOCACHE allowed it in answers showing only the URL, title and snippet; with both, Bing treated the page as NOCACHE. Write the matching ai-grounding and ai-training values; don't assume the old tags carry over.
  6. Sites using NoArchive or NoCache on December 15, 2026 can record a temporary grounding preference in Bing Webmaster Tools. Do it before March 1, 2027: without it, those pages default to Allow for grounding until Bing recrawls them and finds the new tag. A temporary preference ends at recrawl or on September 30, 2027, whichever comes first.
  7. Publishing a tag doesn't activate it; Bing has to recrawl the page. Microsoft says submitting changed URLs with IndexNow raises the chance of a recrawl but doesn't guarantee a date.
  8. Expect a cost if you disallow grounding. Microsoft says it significantly reduces your visibility in AI-generated experiences, and that allowing it makes your pages eligible for answers with links and citations. It also says neither choice guarantees inclusion, traffic or payment.
  9. Keep a dated record of what you published and when: the robots.txt version, the template change and the Bing Webmaster Tools entry. If a page shows up in an answer after you opted out, that record is what you can point to.

What is the difference between Bing's ai-training and ai-grounding preferences?

AI Training covers using a page to change the learned parameters of a generative AI model. Microsoft adopts the shared robots.txt syntax from the IETF AI Preferences work ("User-Agent: __usage_ai-training" with Allow or Disallow lines) for a site or path, and adds a page-level form, ai-training:disallow in a Bingbot meta tag or X-Robots-Tag header, that overrides robots.txt for that page.

Will Bing still honor noarchive and nocache for Copilot and AI training after 2027?

Microsoft introduced NOARCHIVE and NOCACHE as Bing Chat controls in September 2023, and its robots meta tag page still describes them that way: NOARCHIVE means don't link in Chat and Copilot and don't use the content for training; NOCACHE means show only the URL, snippet and title in Chat or Copilot and train only on those; both together are treated as NOCACHE.

What do you lose by blocking Bingbot or disallowing AI grounding, and does it affect Bing search?

Blocking Bingbot or adding noindex: you leave Bing search, and Copilot's web answers draw on what Bing has indexed, so you also lose any chance of being cited. ai-grounding:disallow: you stay eligible for Bing results, but Microsoft warns your visibility in AI experiences drops significantly. disallowextended: you keep Microsoft's own answers and drop only the grounding it supplies to other companies' AI products. ai-training:disallow: no effect on search or grounding.

How do I ask Rightshold about this (free, no key)?

Add the MCP server https://www.rightshold.com/mcp to Claude, Cursor, ChatGPT, Grok or VS Code, then ask: “Before we change our Bing tags, what does example.com's robots.txt tell the AI training, AI search and user-fetch crawlers today, which group did each one match, and does it publish Content-Signal or TDMRep preferences?”

One-click setup

{
  "tool": "read_ai_policy",
  "arguments": {
    "domain": "example.com"
  }
}

Rightshold reads a site's public crawl and AI-use signals. It isn't affiliated with Microsoft, can't see how Bing or Copilot uses your pages and can't make any company honor a preference. Settings and dates are as Microsoft announced them on the Bing blog on October 30, 2026 and described on its robots meta tag page, both checked on November 11, 2026; Microsoft may change them before they take effect on February 1, 2027. Not legal advice.

What are the sources?

Related

Not legal advice. JSON · Markdown · All answers

Get a free API key in one call

No card and no email needed. 100 free credits; the license and policy checks stay free without a key.

curl -s -X POST https://www.rightshold.com/v1/accounts/signup -H "Content-Type: application/json" -d '{"accept_terms":true}'
export RIGHTSHOLD_API_KEY=rs_...   # the api_key from the reply (shown once)
curl -s https://www.rightshold.com/v1/licenses/check -H "Authorization: Bearer $RIGHTSHOLD_API_KEY" \
  -H "Content-Type: application/json" -d '{"license":"MIT","intended_use":{"commercial_use":true}}'