Does drom.ru block AI crawlers?

Can AI assistants cite drom.ru?

• ChatGPT search: its search crawlers may read the site
• Claude: its search crawlers may read the site
• Perplexity: its search crawlers may read the site

drom.ru doesn't opt out of AI model training through robots.txt. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.

AI crawler access, bot by bot

How drom.ru compares

• 19% of the 1,278 popular sites we checked block GPTBot; drom.ru does not.
• 18% of the 1,278 popular sites we checked block ClaudeBot; drom.ru does not.
• 14% of the 1,278 popular sites we checked block PerplexityBot; drom.ru does not.
• Among 194 sites of similar popularity, 31% block at least one AI crawler.

The robots.txt rules that apply to AI crawlers

User-agent: *
Disallow: *=&*
Disallow: *=$
Disallow: *redirect
Disallow: *?tcb=*
Disallow: *?my=*
Disallow: */add_5kopeek/
Disallow: *pageNumber=*
Disallow: *return_to=*
Disallow: *&t=*
Disallow: *?t=*
Disallow: *&s=*
Disallow: *?s=*
Disallow: *&c=*
Disallow: *?c=*
Disallow: *ajax=*
Disallow: *_suggest=*
Disallow: *from=*
Disallow: *f44=*
Disallow: *platform=*
Disallow: *engineType=*
Disallow: *cmodelid=*
Disallow: *cfirmid=*
Disallow: /autoleasing/
Disallow: *etext=*
Disallow: /*?$
Disallow: *.jpg/$
Disallow: /my/
Disallow: /pdd/*/result/
Disallow: /pdd/*/*result=*
Disallow: /sso/request
Disallow: *rid=*
Disallow: *cid=*
Disallow: *fid=*
Disallow: *mid=*
Disallow: *section_id=*
Disallow: *location=*
Disallow: *updates=*
Disallow: /moto/*frametype=*
Disallow: /moto/*fueltype=*
Disallow: /profile.php

Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.

Sites with a similar AI policy

• dell.com · 0 blocked
• wiley.com · 0 blocked
• php.net · 0 blocked
• etsy.com · 0 blocked
• aliyun.com · 0 blocked
• harvard.edu · 0 blocked
• ip-api.com · 0 blocked
• ok.ru · 0 blocked

All sites that are “open to ai crawlers” →