Does mediaexpert.pl block AI crawlers?
Open to AI crawlers
mediaexpert.pl doesn't block any of the major AI crawlers we track in its robots.txt.
Checked from mediaexpert.pl/robots.txt. Robots rules change; the live file is the source of truth.
- AI crawlers blocked
- 0 of 12
- AI bots named in robots.txt
- 2
- llms.txt
- Not found
- Popularity
- Tranco top 2,000 (#1,344)
Can AI assistants cite mediaexpert.pl?
- ChatGPT search: its search crawlers may read the site
- Claude: its search crawlers may read the site
- Perplexity: its search crawlers may read the site
mediaexpert.pl doesn't opt out of AI model training through robots.txt. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.
AI crawler access, bot by bot
| Crawler | Used for | Status on mediaexpert.pl |
|---|---|---|
| GPTBotOpenAI | AI training | Allowed |
| OAI-SearchBotOpenAI | AI answers | Allowed |
| ChatGPT-UserOpenAI | AI answers | Some paths restricted |
| ClaudeBotAnthropic | AI training | Some paths restricted |
| Claude-SearchBotAnthropic | AI answers | Some paths restricted |
| Claude-UserAnthropic | AI answers | Some paths restricted |
| PerplexityBotPerplexity | AI answers | Some paths restricted |
| Google-ExtendedGoogle | AI training | Some paths restricted |
| Applebot-ExtendedApple | AI training | Some paths restricted |
| CCBotCommon Crawl | AI training | Some paths restricted |
| BytespiderByteDance | AI training | Some paths restricted |
| Meta-ExternalAgentMeta | AI training | Some paths restricted |
How mediaexpert.pl compares
- 19% of the 1,278 popular sites we checked block GPTBot; mediaexpert.pl does not.
- 18% of the 1,278 popular sites we checked block ClaudeBot; mediaexpert.pl does not.
- 14% of the 1,278 popular sites we checked block PerplexityBot; mediaexpert.pl does not.
- Among 181 sites of similar popularity, 28% block at least one AI crawler.
The robots.txt rules that apply to AI crawlers
User-agent: * Disallow: /cart/ Disallow: /koszyk/ Disallow: /profile/* Disallow: /sledzenie Disallow: /login Disallow: /search/ Disallow: /newslettter/ Disallow: *search?query* Disallow: /newletter/ Disallow: /pdf/* Disallow: /akcesoria-koszyk/ Disallow: /product/ Disallow: /lp/* Disallow: /lp,testsg* Disallow: /lp,14346-mad-dog* Disallow: /cwicz-forme* Disallow: /lp,15401_CCC-gotze&jensen-setti* Disallow: /ulubione* Disallow: /lp,okazje-1 Disallow: /lp,okazje-2 Disallow: /lp,okazje-3 Disallow: /lp,dis Disallow: /lp,podglad-online* Disallow: /r/* Disallow: /status-zamowienia/* Disallow: /redirect/* Disallow: /lp,rezygnacja-off-kod Disallow: /lp,rezygnacjazkonta Disallow: /lp,rezygnacja-off-kod-oldcode Disallow: /lp,rezygnacja-kod Disallow: /lp,rezygnacja-off Disallow: /lp,rezygnacja-new Disallow: /lp,rezygnacja Disallow: /lp,podglad-online-newsletter Disallow: /lp,newsletter-usun-syn Disallow: /lp,newsletter-usun-b2b Disallow: /lp,newsletter,s Disallow: /lp,newsletter-usun-off Disallow: /lp,newsletter-usun-bez-rejestracji Disallow: /lp,newsletter-crm User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: /
Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.
Sites with a similar AI policy
Does mediaexpert.pl block GPTBot?
No. As of Oct 2, 2026, mediaexpert.pl's robots.txt doesn't block GPTBot.
Can ChatGPT search show results from mediaexpert.pl?
Its robots.txt doesn't block OAI-SearchBot or ChatGPT-User, so ChatGPT's search crawlers may read it. Whether pages are actually shown depends on ChatGPT.
Does mediaexpert.pl have an llms.txt file?
We didn't find a valid llms.txt at mediaexpert.pl/llms.txt when we checked.
Data: mediaexpert.pl's public robots.txt and llms.txt, fetched by AskableHQ. Popularity rank from the Tranco list (ID Y83YG). Methodology.