Which websites block GPTBot?
GPTBot is OpenAI's crawler that collects content that may be used to train OpenAI's models. Of the 1,278 popular websites we checked, 248 (19%) block it completely and 814 restrict some paths. 290 sites name it explicitly in robots.txt.
How to block or allow GPTBot
# block User-agent: GPTBot Disallow: / # allow User-agent: GPTBot Allow: /
GPTBot is a training crawler: blocking it opts out of model training but doesn't by itself remove you from AI answers. Check your robots.txt.
Sites that block GPTBot (248)
- instagram.com
- mail.ru
- twitter.com
- amazon.com
- whatsapp.net
- x.com
- pinterest.com
- tiktok.com
- yahoo.com
- myfritz.net
- msn.com
- baidu.com
- vimeo.com
- reddit.com
- registrar-servers.com
- snapchat.com
- gravatar.com
- nytimes.com
- flickr.com
- soundcloud.com
- medium.com
- cnn.com
- ebay.com
- t-online.de
- forbes.com
- bbc.com
- canva.com
- meraki.com
- imdb.com
- launchpad.net
- reuters.com
- nature.com
- weibo.com
- alibaba.com
- skybridge.click
- naver.com
- bloomberg.com
- espn.com
- globo.com
- go.com
- claude.ai
- aol.com
- pixabay.com
- goodreads.com
- cnbc.com
- statista.com
- sohu.com
- quora.com
- behance.net
- tandfonline.com
- tripadvisor.com
- usatoday.com
- threads.com
- imgsmail.ru
- telegraph.co.uk
- sharethrough.com
- techcrunch.com
- yelp.com
- dailymail.com
- hihonorcloud.com
- cbsnews.com
- fb.com
- pinimg.com
- bandcamp.com
- quantserve.com
- airbnb.com
- apnews.com
- ted.com
- adform.net
- lefigaro.fr
- academia.edu
- pexels.com
- daum.net
- figma.com
- hbr.org
- nbcnews.com
- latimes.com
- mercadolivre.com.br
- genius.com
- mercadolibre.com.ar
- mailchi.mp
- repubblica.it
- webmd.com
- corriere.it
- btloader.com
- elmundo.es
- flightradar24.com
- letterboxd.com
- n-tv.de
- pbs.org
- archiveofourown.org
- huffpost.com
- marca.com
- tabelog.com
- xiaohongshu.com
- skysports.com
- cookpad.com
- gsmarena.com
- economist.com
- theconversation.com
- netcraze.io
- ad.nl
- nu.nl
- namu.wiki
- vnexpress.net
- fmkorea.com
- dcinside.com
- rightmove.co.uk
- pandora.com
- gazzetta.it
- hln.be
- kakao.com
- abc.net.au
- themoviedb.org
- ladepeche.fr
- mydramalist.com
- spiegel.de
- actu.fr
- jstor.org
- sapo.pt
- nikkansports.com
- dagbladet.no
- ilmeteo.it
- iltalehti.fi
- zedge.net
- eenadu.net
- tjk.org
- aka.ms
- imgsrc.ru
- keirin.jp
- shutterstock.com
- usnews.com
- mobcup.fm
- vinted.fr
- qcloud.com
- newsweek.com
- ixl.com
- merkur.de
- zdnet.com
- rocketmoney.dev
- adrta.com
- liquipedia.net
- meb.gov.tr
- sciencemag.org
- iqiyi.com
- wikihow.com
- oreilly.com
- euronews.com
- blackhub.team
- pnas.org
- lnkd.in
- strava.com
- meetup.com
- sedoparking.com
- clevertap-prod.com
- science.org
- secureserver.net
- ign.com
- salesforceliveagent.com
- adsco.re
- mashable.com
- openssl.org
- medicalnewstoday.com
- mparticle.com
- variety.com
- mirror.co.uk
- photobucket.com
- sendbird.com
- disney.com
- instacart.com
- umd.edu
- congress.gov
- inc.com
- co.com
- mos.ru
- nejm.org
- rollingstone.com
- nba.com
- redditmedia.com
- slate.com
- abcnews.com
- tidal.com
- express.co.uk
- hollywoodreporter.com
- news.com.au
- rockstargames.com
- zeit.de
- expressapisv2.net
- smh.com.au
- pxf.io
- leparisien.fr
- thehill.com
- tmdb.org
- grok.com
- huntress.io
- cell.com
- system-monitor.com
- newscientist.com
- ksapisrv.com
- franceinfo.fr
- salesforce-scrt.com
- mastodon.social
- sueddeutsche.de
- glassdoor.com
- idnes.cz
- jwpltx.com
- chicagotribune.com
- prezi.com
- osu.edu
- imageshack.us
- medscape.com
- nrk.no
- ctvnews.ca
- irishtimes.com
- france24.com
- yumpu.com
- hellotalk8.com
- theregister.com
- loom.com
- tagesschau.de
- cbssports.com
- newsbreak.com
- yr.no
- kahoot.it
- crunchbase.com
- nicovideo.jp
- myanimelist.net
- metro.co.uk
- siteforce.com
- unep.org
- nzherald.co.nz
- worldcat.org
- zalando.de
- flipboard.com
- dictionary.com
- nate.com
- tagesspiegel.de
- permutive.app
- flightaware.com
- foursquare.com
- cuny.edu
- 123rf.com
- ebsco.com
- deadline.com
- vietnam.vn
- orf.at
- hse.ru
- ansa.it
Popular sites that allow GPTBot
What is GPTBot?
GPTBot is operated by OpenAI. According to OpenAI's documentation, it collects content that may be used to train OpenAI's models.
How many websites block GPTBot?
248 of the 1278 popular websites in our directory (19%) block it completely in robots.txt.
Should I block GPTBot?
It depends on whether you're comfortable with your content being used for AI training. Blocking it doesn't remove you from AI answers, which use separate crawlers.