Does behance.net block AI crawlers?

Can AI assistants cite behance.net?

• ChatGPT search: its search crawlers may read the site
• Claude: its search crawlers may read the site
• Perplexity: its search crawlers may read the site

behance.net opts out of AI training by OpenAI, Anthropic, Google, Apple, Common Crawl, ByteDance, Meta. Training crawlers and answer crawlers are separate: blocking training doesn't by itself remove a site from AI answers.

AI crawler access, bot by bot

How behance.net compares

• 19% of the 1,278 popular sites we checked block GPTBot; behance.net is one of them.
• 18% of the 1,278 popular sites we checked block ClaudeBot; behance.net is one of them.
• 14% of the 1,278 popular sites we checked block PerplexityBot; behance.net does not.
• Among 206 sites of similar popularity, 28% block at least one AI crawler.

The robots.txt rules that apply to AI crawlers

User-agent: AI2Bot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCbot
User-agent: Claude-Web
User-agent: ClaudeBot
User-agent: cohere-training-data-crawler
User-agent: Diffbot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: GPTBot
User-agent: ImagesiftBot
User-agent: Kangaroo Bot
User-agent: Meta-ExternalAgent
User-agent: Omgili
User-agent: Omgilibot
User-agent: PanguBot
User-agent: Timpibot
User-agent: Webzio-Extended
Disallow: /

User-agent: *
Disallow: /v2/
Disallow: /v3/
Disallow: /log$
Disallow: /search/*?*assetsCategory=*
Disallow: /search/*?*assetsPriceTier=*
Disallow: /search/*?*assetsExtensionTypes=*
Disallow: /search/*?*color_hex=*
Disallow: /search/*?*country=*
Disallow: /search/*?*exif_aperture=*
Disallow: /search/*?*exif_focal_length=*
Disallow: /search/*?*exif_lens_brand=*
Disallow: /search/*?*exif_make=*
Disallow: /search/*?*exif_shutter_speed=*
Disallow: /search/*?*exif_zoom=*
Disallow: /search/*?*field=*
Disallow: /search/*?*gif=*
Disallow: /search/*?*premium=*
Disallow: /search/*?*sort=*
Disallow: /search/*?*schools=*
Disallow: /search/*?*tools=*
Disallow: /search/*?*time=*
Disallow: /search/*?*userAvailability=*
Disallow: /hire/browse
Disallow: /*/undefined

Excerpt: only groups for all user-agents (*) or named AI crawlers, up to 40 rules per group.

Sites with a similar AI policy

• scribd.com · 3 blocked
• slideshare.net · 3 blocked
• tandfonline.com · 1 blocked
• goodreads.com · 2 blocked
• pixabay.com · 6 blocked
• aol.com · 5 blocked
• businessinsider.com · 3 blocked
• tripadvisor.com · 6 blocked

All sites that are “blocks ai training, allows ai answers” →