Which websites block Applebot-Extended?
Applebot-Extended is Apple's crawler that controls use of content to train Apple's AI models. Of the 1,278 popular websites we checked, 205 (16%) block it completely and 872 restrict some paths. 177 sites name it explicitly in robots.txt.
How to block or allow Applebot-Extended
# block User-agent: Applebot-Extended Disallow: / # allow User-agent: Applebot-Extended Allow: /
Applebot-Extended is a training crawler: blocking it opts out of model training but doesn't by itself remove you from AI answers. Check your robots.txt.
Sites that block Applebot-Extended (205)
- instagram.com
- mail.ru
- twitter.com
- whatsapp.net
- netflix.com
- x.com
- pinterest.com
- tiktok.com
- myfritz.net
- msn.com
- baidu.com
- reddit.com
- registrar-servers.com
- snapchat.com
- nytimes.com
- flickr.com
- soundcloud.com
- medium.com
- cnn.com
- theguardian.com
- ebay.com
- t-online.de
- forbes.com
- bbc.com
- canva.com
- meraki.com
- imdb.com
- launchpad.net
- reuters.com
- nature.com
- weibo.com
- skybridge.click
- naver.com
- trustpilot.com
- washingtonpost.com
- bloomberg.com
- wsj.com
- pixabay.com
- cnbc.com
- statista.com
- sohu.com
- quora.com
- behance.net
- ft.com
- wired.com
- uol.com.br
- tripadvisor.com
- usatoday.com
- threads.com
- imgsmail.ru
- telegraph.co.uk
- sharethrough.com
- techcrunch.com
- yelp.com
- dailymail.com
- hihonorcloud.com
- lemonde.fr
- fb.com
- pinimg.com
- quantserve.com
- airbnb.com
- bild.de
- zillow.com
- apnews.com
- ted.com
- welt.de
- people.com
- adform.net
- academia.edu
- pexels.com
- daum.net
- nbcnews.com
- genius.com
- mailchi.mp
- repubblica.it
- corriere.it
- btloader.com
- investopedia.com
- theatlantic.com
- letterboxd.com
- huffpost.com
- xiaohongshu.com
- aftonbladet.se
- cookpad.com
- nypost.com
- economist.com
- theconversation.com
- netcraze.io
- ad.nl
- nu.nl
- namu.wiki
- vnexpress.net
- vg.no
- fmkorea.com
- dcinside.com
- pandora.com
- gazzetta.it
- amap.com
- hln.be
- kakao.com
- themoviedb.org
- mydramalist.com
- spiegel.de
- actu.fr
- sapo.pt
- dagbladet.no
- ilmeteo.it
- iltalehti.fi
- eenadu.net
- tjk.org
- aka.ms
- keirin.jp
- usnews.com
- qcloud.com
- newsweek.com
- newyorker.com
- ixl.com
- merkur.de
- zdnet.com
- rocketmoney.dev
- hola.com
- adrta.com
- marketwatch.com
- meb.gov.tr
- sciencemag.org
- wikihow.com
- blackhub.team
- lnkd.in
- sedoparking.com
- clevertap-prod.com
- science.org
- secureserver.net
- salesforceliveagent.com
- adsco.re
- mashable.com
- thesun.co.uk
- sap.com
- openssl.org
- medicalnewstoday.com
- mparticle.com
- variety.com
- mirror.co.uk
- sendbird.com
- instacart.com
- inc.com
- co.com
- guardian.co.uk
- rollingstone.com
- nba.com
- redditmedia.com
- slate.com
- tidal.com
- express.co.uk
- hollywoodreporter.com
- news.com.au
- rockstargames.com
- zeit.de
- expressapisv2.net
- smh.com.au
- sfgate.com
- pxf.io
- kuaishou.com
- thehill.com
- tmdb.org
- grok.com
- huntress.io
- system-monitor.com
- newscientist.com
- ksapisrv.com
- franceinfo.fr
- salesforce-scrt.com
- glassdoor.com
- venturebeat.com
- jwpltx.com
- chicagotribune.com
- osu.edu
- imageshack.us
- nrk.no
- thetimes.co.uk
- yumpu.com
- hellotalk8.com
- theregister.com
- sas.com
- tagesschau.de
- newsbreak.com
- yr.no
- kahoot.it
- crunchbase.com
- vogue.com
- myanimelist.net
- metro.co.uk
- siteforce.com
- unep.org
- allrecipes.com
- nzherald.co.nz
- zalando.de
- dictionary.com
- nate.com
- tagesspiegel.de
- permutive.app
- cuny.edu
- nymag.com
- ebsco.com
- deadline.com
- vietnam.vn
Popular sites that allow Applebot-Extended
What is Applebot-Extended?
Applebot-Extended is operated by Apple. According to Apple's documentation, it controls use of content to train Apple's AI models.
How many websites block Applebot-Extended?
205 of the 1278 popular websites in our directory (16%) block it completely in robots.txt.
Should I block Applebot-Extended?
It depends on whether you're comfortable with your content being used for AI training. Blocking it doesn't remove you from AI answers, which use separate crawlers.