Nutch-based Bot Disallow

Nutch-based Bot Disallow tracking and usage

Websites using Nutch-based Bot Disallow over time
41,328websites on 11 Nov 2026
010,00020,00030,00040,00050,0002026-08-152026-09-232026-10-142026-11-012026-11-11

About Nutch-based Bot Disallow

This website has found the Disallow rules for Nutch-based Bot.

Websites using Nutch-based Bot Disallow by countrymarket share
27%
🇺🇸US
6.8%
🇧🇷BR
6.3%
🇩🇪DE
5.6%
🇦🇷AR
5.2%
🇦🇺AU
5%
🇬🇧GB
4.3%
🇫🇷FR
3%
🇨🇦CA
Websites using Nutch-based Bot Disallow by industrymarket share · top 6 industries
Shopping
58%
Fashion & Beauty
19%
Food & Drink
6.9%
SaaS & Cloud
6%
Technology & Computing
5.9%
Construction
4.3%
0%15%30%45%60%

Websites using Nutch-based Bot Disallow

showing 25 of 41,328
WebsiteCountryTrafficIndustry
slate.com🇺🇸USTop 1KPrint & Publishing
sagepub.com🇺🇸USTop 1KPrint & Publishing
theverge.com🇺🇸USTop 1KNews & Weather
figma.com🇺🇸USTop 1KDesign & Creative
python.org🇺🇸USTop 1KSoftware Development
repubblica.it🇮🇹ITTop 1KNews & Weather
elpais.com🇪🇸ESTop 1KNews & Weather
nintendo.com🇺🇸USTop 1KGaming
independent.co.uk🇬🇧GBTop 1KEntertainment
aol.com🇺🇸USTop 1KSoftware Development
cnet.com🇺🇸USTop 1KEntertainment
rfi.fr🇫🇷FRTop 5KNews & Weather
sbs.com.au🇦🇺AUTop 5KMovies & TV
yomiuri.co.jp🇯🇵JPTop 5KNews & Weather
dejure.org🇩🇪DETop 5KTechnology & Computing
news24.com-Top 5KMovies & TV
lastampa.it🇮🇹ITTop 5KNews & Weather
20minutes.fr🇫🇷FRTop 5KNews & Weather
screenrant.com🇨🇦CATop 5KEntertainment
thrillist.com🇺🇸USTop 5KNews & Weather
bhf.org.uk🇬🇧GBTop 5KNon-profit & Charity
dukeupress.edu🇺🇸USTop 5KEducation
sbnation.com🇺🇸USTop 5KNews & Weather
thecut.com🇺🇸USTop 5KNews & Weather
elmundo.es🇪🇸ESTop 5KNews & Weather
Showing 25 of 41,328 websitesView detailed list →