AI Bots
AI bots by ChatGPT, Bing and Meta are roaming internet, downloading anything they can find ...
KEEP READINGAdsbot
Bot Name: Adsbot, WebNX, Inc. IP: 173.231.60.196 (ip-173-231-60-196.seostar.co) IP Range: 173.231.60.0/23 Useragent: Mozilla/5.0 (compatible; Adsbot/3.1; ...
KEEP READINGHangzhou Alibaba Advertising Co.,Ltd.
Bot Name: Hangzhou Alibaba Advertising Co.,Ltd. IP: 39.98.121.147 IP Range: 39.96.0.0/14 Purpose: indexing/scraping Benefit to ...
KEEP READINGAhrefs
Bot Name: Ahrefs IP: 54.36.148.173 (ip-54-36-1XX-79.a.ahrefs.com) IP Range: 54.36.0.0/16 HOST: OVH SAS Purpose: indexing/scraping Benefit ...
KEEP READINGYANDEX LLC
Bot Name: YANDEX LLC IP: 77.88.5.56 (77-88-5-56.spider.yandex.com) IP Range: 77.88.0.0/18 Specifically disallow Yandex bots in ...
KEEP READINGMojeekBot
Bot Name: MojeekBot User Agent: Mozilla/5.0 (compatible; MojeekBot/0.10; +https://www.mojeek.com/bot.html) IP: 5.102.173.71 (crawl-5-102-173-71.mojeek.com) IP Range: CustodianDC ...
KEEP READINGScreaming Frog SEO Spider
Bot Name: Screaming Frog SEO Spider User Agent: Screaming Frog SEO Spider/16.1 IP: 66.131.201.220 (modemcable220.201-131-66.mc.videotron.ca) ...
KEEP READINGInternet Archive
Bot Name: Internet Archive IP: 207.241.230.103 IP Range: 207.241.224.0/20 IP: 207.241.232.92 IP Range: 207.241.224.0/20 Purpose: ...
KEEP READINGExabot
Bot Name: Exabot UserAgent: Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) IP: 154.72.161.137 Purpose: indexing/scraping Benefit to your ...
KEEP READINGLinespider
Bot Name: Linespider UserAgent: Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH) IP: 147.92.153.18 (crawl.147-92-153-18.search.line-apps.com) “Linespider is a Web ...
KEEP READING