Rightshold™ Sign up

Answers · AI crawlers

ElevenlabsCrawler has suddenly become one of the busiest bots in our logs. What is it, should we block it in robots.txt, and will blocking it stop ElevenLabs voice agents that customers point at our site from reading our pages? Can we tell whether the requests are really from ElevenLabs?

Last updated

TL;DR: ElevenlabsCrawler is ElevenLabs' training crawler. Its bots page says it crawls the web to collect content that may be used to train ElevenLabs' generative AI models, and that disallowing it in robots.txt indicates a site's content should not be used for training. ElevenLabs runs a second, separate agent, ElevenlabsBot, which fetches the pages that ElevenLabs customers add to their agents' knowledge bases, when they add them and when they refresh them; it honors robots.txt. ElevenLabs says the two settings are independent, so "User-agent: ElevenlabsCrawler" with "Disallow: /" opts you out of training while customers' voice agents can still read your public pages, and changes apply within about 24 hours. The catch is the other direction: ElevenLabs' knowledge-base docs say pages disallowed for ElevenlabsBot or for all user agents are skipped, so a blanket "User-agent: *" block also cuts off those agents. And you can't prove a request is really ElevenLabs: its bots page publishes no IP ranges or reverse-DNS pattern, so the user-agent string, which anyone can copy, is all you have.

What should I check, step by step?

1. Find both tokens in your logs separately: "ElevenlabsCrawler" (training; full string Mozilla/5.0 (compatible; ElevenlabsCrawler/1.0; +https://elevenlabs.io/docs/bots)) and "ElevenlabsBot" (knowledge-base fetches; ElevenlabsBot/1.0). ElevenLabs says the version numbers may change, so match the token, not the whole string.

  1. To opt out of training, add "User-agent: ElevenlabsCrawler" then "Disallow: /" (or only the sections you want excluded). Allow about 24 hours for ElevenLabs to pick it up.
  2. If you want customers' ElevenLabs voice agents and receptionists to be able to learn from your public pages (support docs, pricing, opening hours), leave ElevenlabsBot allowed, and check that a "User-agent: *" Disallow isn't catching it: ElevenLabs says pages disallowed for all user agents are skipped too.
  3. If you block ElevenlabsBot on purpose, expect customers to see failed imports; ElevenLabs tells them to check that the site allows its crawler user agent, and its receptionist docs suggest adding single pages or uploading the content as a file instead.
  4. Check your CDN, WAF or bot-protection rules as well as robots.txt. ElevenLabs asks sites behind them to allow ElevenlabsBot, so a firewall rule can block it even when robots.txt allows it.
  5. Treat the user-agent string as a claim, not proof. With no published IP list, you can't separate genuine ElevenLabs requests from a scraper using the same name. If volume is the problem, rate-limit by IP and path at your server or CDN rather than relying on robots.txt.
  6. Watch for bursts. Independent observers have reported ElevenlabsCrawler sending thousands of requests to a site in a single day, from many hosting networks, then dropping to a trickle.
  7. Keep a dated copy of each robots.txt version, so you can show when you opted out if your content's use for training is ever in question.

What is the difference between ElevenlabsCrawler and ElevenlabsBot?

ElevenLabs' bots page says it uses web crawlers to collect publicly available content for its AI models and to fetch pages for its products, and that site owners can control access with two robots.txt tokens, each independent of the other. ElevenlabsCrawler crawls the web to collect content that may be used to train ElevenLabs' generative AI models; disallowing it indicates your content should not be used for training.

Why is ElevenlabsCrawler sending so many requests, and can you verify it's really ElevenLabs?

Several sites have recently reported ElevenlabsCrawler near the top of their crawler counts. One independent bot tracker reported 8,675 requests to two of its sites between October 19 and 26, 2026, more than any other crawler in the period (ClaudeBot had 4,937), with 8,347 of them on October 22 alone, nearly all answered with a 200, from about ten networks, mostly hosting providers. It noted that it couldn't tell whether those requests were ElevenLabs.

What happens if you block ElevenlabsCrawler or ElevenlabsBot in robots.txt?

Blocking ElevenlabsCrawler: by ElevenLabs' own description, it's the training crawler and it's independent of ElevenlabsBot, so the visible cost is close to none. It sends no visitors back. What you give up is having your content considered for training ElevenLabs' models.

How do I ask Rightshold about this (free, no key)?

Add the MCP server https://www.rightshold.com/mcp to Claude, Cursor, ChatGPT, Grok or VS Code, then ask: “What does example.com's robots.txt say to all user agents today, which AI crawlers does it already block, and does it publish a Content-Signal preference for AI training?”

One-click setup

{
  "tool": "read_ai_policy",
  "arguments": {
    "domain": "example.com"
  }
}

Rightshold reads a site's public crawl and AI-use signals. It isn't affiliated with ElevenLabs, can't verify which requests come from ElevenLabs and can't make any crawler honor a preference. Bot behavior is as ElevenLabs describes it on its bots and knowledge-base pages, checked on November 10, 2026; traffic figures are third-party and Rightshold observations of requests carrying the user-agent string, not confirmed ElevenLabs traffic. Not legal advice.

What are the sources?

Related

Not legal advice. JSON · Markdown · All answers

Get a free API key in one call

No card and no email needed. 100 free credits; the license and policy checks stay free without a key.

curl -s -X POST https://www.rightshold.com/v1/accounts/signup -H "Content-Type: application/json" -d '{"accept_terms":true}'
export RIGHTSHOLD_API_KEY=rs_...   # the api_key from the reply (shown once)
curl -s https://www.rightshold.com/v1/licenses/check -H "Authorization: Bearer $RIGHTSHOLD_API_KEY" \
  -H "Content-Type: application/json" -d '{"license":"MIT","intended_use":{"commercial_use":true}}'