Does liquipedia.net block AI crawlers?
Blocks AI training and AI answers
liquipedia.net blocks both AI training crawlers and AI answer crawlers in its robots.txt.
Checked from liquipedia.net/robots.txt. Robots rules change; the live file is the source of truth.
- AI crawlers blocked
- 4 of 12
- AI bots named in robots.txt
- 4
- llms.txt
- Not found
- Popularity
- Tranco top 2,000 (#1,905)
Can AI assistants cite liquipedia.net?
- ChatGPT search: its search crawler is blocked
- Claude: its search crawlers may read the site
- Perplexity: its search crawlers may read the site
liquipedia.net opts out of AI training by OpenAI, Anthropic, Meta. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.
AI crawler access, bot by bot
| Crawler | Used for | Status on liquipedia.net |
|---|---|---|
| GPTBotOpenAI | AI training | Blocked |
| OAI-SearchBotOpenAI | AI answers | Some paths restricted |
| ChatGPT-UserOpenAI | AI answers | Blocked |
| ClaudeBotAnthropic | AI training | Blocked |
| Claude-SearchBotAnthropic | AI answers | Some paths restricted |
| Claude-UserAnthropic | AI answers | Some paths restricted |
| PerplexityBotPerplexity | AI answers | Some paths restricted |
| Google-ExtendedGoogle | AI training | Some paths restricted |
| Applebot-ExtendedApple | AI training | Some paths restricted |
| CCBotCommon Crawl | AI training | Some paths restricted |
| BytespiderByteDance | AI training | Some paths restricted |
| Meta-ExternalAgentMeta | AI training | Blocked |
How liquipedia.net compares
- 19% of the 1,278 popular sites we checked block GPTBot; liquipedia.net is one of them.
- 18% of the 1,278 popular sites we checked block ClaudeBot; liquipedia.net is one of them.
- 14% of the 1,278 popular sites we checked block PerplexityBot; liquipedia.net does not.
- Among 149 sites of similar popularity, 25% block at least one AI crawler.
The robots.txt rules that apply to AI crawlers
User-agent: HTTrack User-agent: wget User-agent: XoviBot User-agent: AhrefsBot User-agent: AhrefsSiteAudit User-agent: Riddler User-agent: FDM User-agent: ExtLinksBot User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: MJ12bot User-agent: QuetextBot User-agent: BLEXBot User-agent: grapeshot User-agent: BluechipBacklinks User-agent: barkrowler User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: cohere-ai User-agent: DataForSeoBot User-agent: PetalBot User-agent: meta-externalagent User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: Amazonbot User-agent: ChatGPT-User User-agent: IbouBot User-agent: YouBot Disallow: / User-agent: * Disallow: /starcraft/index.php Disallow: /starcraft/Special:Contributions/ Disallow: /starcraft/Special:WhatLinksHere/ Disallow: /starcraft/Special:UserLogin/ Disallow: /starcraft/Special:SearchByProperty Disallow: /starcraft/Special:SearchByProperty/ Disallow: /starcraft/Special:Browse Disallow: /starcraft/Special:Browse/ Disallow: /starcraft/Special:Ask Disallow: /starcraft/Special:Ask/ Disallow: /starcraft/Special:ExportRDF Disallow: /starcraft/Special:ExportRDF/ Disallow: /starcraft/Special:RecentChangesLinked Disallow: /starcraft/Special:RecentChangesLinked/ Disallow: /starcraft/Special:Search/ Disallow: /starcraft/Special:Log/ Disallow: /starcraft/Special:PageProperty/ Disallow: /starcraft/Special:PrefixIndex/ Disallow: /starcraft/Special:UserRights/ Disallow: /starcraft/Special:FilePath/ Disallow: /starcraft/Special:Redirect/ Disallow: /starcraft/Special:RunQuery/ Disallow: /starcraft/Special:GlobalWhatLinksHere/ Disallow: /starcraft/Special:Stream/ Disallow: /starcraft/Special:Sitemap/ Disallow: /starcraft/Template:TeamPart/ Disallow: /starcraft/Template:TeamPage/ Disallow: /starcraft/Template:TeamIcon/ Disallow: /starcraft/Template:TeamBracket/ Disallow: /starcraft/Template:Team/ Disallow: /starcraft/Template:TeamShort/ Disallow: /starcraft/TemplateArchive:TeamPart/ Disallow: /starcraft/TemplateArchive:TeamPage/ Disallow: /starcraft/TemplateArchive:TeamIcon/ Disallow: /starcraft/TemplateArchive:TeamBracket/ Disallow: /starcraft/TemplateArchive:Team/ Disallow: /starcraft/TemplateArchive:TeamShort/ Disallow: /starcraft/TemplateArchive:Team2Short/ Disallow: /starcraft/api.php Disallow: /starcraft/Liquipedia:Upcoming_and_ongoing_matches/
Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.
Sites with a similar AI policy
Does liquipedia.net block GPTBot?
Yes. As of Oct 2, 2026, liquipedia.net's robots.txt disallows GPTBot, OpenAI's training crawler.
Can ChatGPT search show results from liquipedia.net?
Its robots.txt blocks a ChatGPT search crawler, so ChatGPT search is unlikely to read or cite those pages.
Does liquipedia.net have an llms.txt file?
We didn't find a valid llms.txt at liquipedia.net/llms.txt when we checked.
Data: liquipedia.net's public robots.txt and llms.txt, fetched by AskableHQ. Popularity rank from the Tranco list (ID Y83YG). Methodology.