Adsbot

Bot Name: Adsbot, WebNX, Inc. IP: 173.231.60.196 (ip-173-231-60-196.seostar.co) IP Range: 173.231.60.0/23 Useragent: Mozilla/5.0 (compatible; Adsbot/3.1; +https://seostar.co/robot/) Purpose: indexing/scraping Benefit to your site? none

Hangzhou Alibaba Advertising Co.,Ltd.

Bot Name: Hangzhou Alibaba Advertising Co.,Ltd. IP: 39.98.121.147 IP Range: 39.96.0.0/14 Purpose: indexing/scraping Benefit to your site? none

Ahrefs

Bot Name: Ahrefs IP: 54.36.148.173 (ip-54-36-1XX-79.a.ahrefs.com) IP Range: 54.36.0.0/16 HOST: OVH SAS Purpose: indexing/scraping Benefit to your site? none

YANDEX LLC

Bot Name: YANDEX LLC IP: 77.88.5.56 (77-88-5-56.spider.yandex.com) IP Range: 77.88.0.0/18 Specifically disallow Yandex bots in robots.txt and they showed up anyway. Purpose: indexing/scraping Benefit to your site? none. If yes, let the box index your site

MojeekBot

Bot Name: MojeekBot User Agent: Mozilla/5.0 (compatible; MojeekBot/0.10; +https://www.mojeek.com/bot.html) IP: 5.102.173.71 (crawl-5-102-173-71.mojeek.com) IP Range: CustodianDC Limited (5.102.173.0/24) Purpose: scraping Benefit to your site? none

Screaming Frog SEO Spider

Bot Name: Screaming Frog SEO Spider User Agent: Screaming Frog SEO Spider/16.1 IP: 66.131.201.220 (modemcable220.201-131-66.mc.videotron.ca) Most of the dubious companies or persons are running bots on cheap servers or VPS from Amazon, but this idiot is running a bot on a cable line – unbelievable. Purpose: scraping Benefit to your site? none

Internet Archive

Bot Name: Internet Archive IP: 207.241.230.103 IP Range: 207.241.224.0/20 IP: 207.241.232.92 IP Range: 207.241.224.0/20 Purpose: indexing Benefit to your site? none

Exabot

Bot Name: Exabot UserAgent: Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) IP: 154.72.161.137 Purpose: indexing/scraping Benefit to your site? none

Linespider

Bot Name: Linespider UserAgent: Mozilla/5.0 (compatible; Linespider/1.1; +https://lin.ee/4dwXkTH) IP: 147.92.153.18 (crawl.147-92-153-18.search.line-apps.com) “Linespider is a Web crawler that provides a wide range of search results for LINE services while complying with the Robots Exclusion Protocol.” Purpose: indexing/scraping Benefit to your site? none

CensysInspect

Bot Name: CensysInspect UserAgent: Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/) IP: 167.94.138.116 “Censys is a platform that helps information security practitioners discover, monitor, and analyze devices that are accessible from the Internet. We regularly probe every public IP address and popular domain names, curate and enrich the resulting data, and make it intelligible through an interactive search …

Read more