Does nicovideo.jp block AI crawlers?

Can AI assistants cite nicovideo.jp?

• ChatGPT search: its search crawlers may read the site
• Claude: its search crawlers may read the site
• Perplexity: its search crawlers may read the site

nicovideo.jp opts out of AI training by OpenAI. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.

AI crawler access, bot by bot

How nicovideo.jp compares

• 19% of the 1,278 popular sites we checked block GPTBot; nicovideo.jp is one of them.
• 18% of the 1,278 popular sites we checked block ClaudeBot; nicovideo.jp does not.
• 14% of the 1,278 popular sites we checked block PerplexityBot; nicovideo.jp does not.
• Among 180 sites of similar popularity, 24% block at least one AI crawler.

The robots.txt rules that apply to AI crawlers

User-agent: GPTBot
Disallow: /

User-agent: *
Disallow: /api/
Allow: /api/nicorepo/timeline
Disallow: /swf/ranking/
Disallow: /swf/stamp/
Disallow: /swf/mylist/
Disallow: /my/
Disallow: /mylist_search/
Disallow: /recommendations/
Disallow: /recommendnews/
Disallow: /thumb_mylist/
Disallow: /mylistcomment/
Disallow: /translation/
Disallow: /stamp_ranking/
Disallow: /stamp/
Disallow: /related_tag/
Disallow: /premium_enquete/
Disallow: /owner_settings/
Disallow: /openlist/
Disallow: /allegation/

Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.

Sites with a similar AI policy

• crunchbase.com · 7 blocked
• myanimelist.net · 7 blocked
• cbssports.com · 1 blocked
• tagesschau.de · 7 blocked
• n-able.com · 1 blocked
• loom.com · 1 blocked
• fool.com · 1 blocked
• sas.com · 2 blocked

All sites that are “blocks ai training, allows ai answers” →