Robots Disallow

Robots Disallow tracking and usage

Websites using Robots Disallow by countrymarket share
10%
🇺🇸US
6.7%
🇮🇳IN
6.7%
🇩🇪DE
6.7%
🇮🇩ID
3.3%
🇬🇧GB
3.3%
🇦🇺AU
3.3%
🇵🇹PT
3.3%
🇨🇳CN
Websites using Robots Disallow by industrymarket share · top 6 industries
SaaS & Cloud
29%
Environment & Sustainability
14%
Wholesale & Distribution
14%
Aerospace & Defense
14%
Marketing & Advertising
14%
Shopping
14%
0%7.5%15%23%30%
Download report

We track 30 websites using Robots Disallow, along with their country, traffic, industry and platforms. There are 3 websites using Robots Disallow in United States.

Filter by country
🇺🇸 United States3 sites
🇮🇳 India2 sites
🇩🇪 Germany2 sites
🇮🇩 Indonesia2 sites
🇬🇧 United Kingdom1 sites
🇦🇺 Australia1 sites
🇵🇹 Portugal1 sites
🇨🇳 China1 sites
🇲🇩 Moldova, Republic of1 sites
🇲🇸 Montserrat1 sites

About Robots Disallow

Sites blocking the Robots crawler in robots.txt.

Categories
Robots.txtWeb Standards

Websites using Robots Disallow

showing 25 of 30
WebsiteCountryTrafficIndustry
sharethrough.com🇺🇸USTop 1KTechnology & Computing
fortinet.com🇺🇸USTop 5KCybersecurity
vtb.ru🇷🇺RUTop 5K-
arte.tv🇫🇷FRTop 5KMovies & TV
yclients.com🇨🇾CYTop 10KTechnology & Computing
lexisnexis.com🇺🇸USTop 10KTechnology & Computing
helsinki.fi🇫🇮FITop 10KEducation
spokeo.com🇺🇸USTop 10KTechnology & Computing
yoshki.com🇬🇧GBTop 50KTechnology & Computing
snapcomms.com🇳🇿NZTop 50KSoftware Development
display.io🇺🇸USTop 50KMarketing & Advertising
surfly.com🇳🇱NLTop 50KTechnology & Computing
spideroak.com🇺🇸USTop 50KSoftware Development
radioshack.com🇺🇸USTop 50KShopping
tekrom.com🇹🇷TRTop 50KTechnology & Computing
unimed.ac.id🇮🇩IDTop 50KEducation
ula.ve🇻🇪VETop 50KEducation
pulseway.com🇮🇪IETop 50KSoftware Development
21cnjy.com🇨🇳CNTop 50KSoftware Development
gitconnected.com🇺🇸USTop 50KTechnology & Computing
niftygateway.com🇺🇸USTop 50KEntertainment
powerdms.com🇺🇸USTop 50KSoftware Development
tib.eu🇩🇪DETop 50KBooks & Literature
tn.edu.tw🇹🇼TWTop 50KEducation
loadbee.com🇩🇪DETop 50KTechnology & Computing
Showing 25 of 30 websitesView detailed list →

Alternatives

same category
HTML5 DocType43.32MsitesFacebook Redirect16.79MsitesInstagram10.91MsitesOrganization Schema6.74MsitesLinkedIn5.78MsitesEvents Page4.13MsitesMembers Page3.56MsitesGoogle AJAX Feed API3.06Msites