Google-Extended Disallow

Google-Extended Disallow

Robots.txt

Sites blocking the Google-Extended crawler in robots.txt.

16
websites using Google-Extended Disallow
Create a technology report →
Export with emails, socials, country, TLD and industry filters
Websites using Google-Extended Disallow by countrymarket share · top 8 countries
🇺🇸United States
31%
🇩🇪Germany
19%
🇬🇧United Kingdom
13%
🇮🇳India
13%
🇦🇺Australia
6.3%
🇨🇾Cyprus
6.3%
🇰🇪Kenya
6.3%
🇲🇩Moldova, Republic of
6.3%
0%10%20%30%40%
Websites using Google-Extended Disallow by industrydetected industries
SaaS & Cloud · 33%Construction · 33%Education · 17%Shopping · 17%MARKETSHARE
SaaS & Cloud33%
Construction33%
Education17%
Shopping17%

Get the free browser extension

Identify the technology stack of any website instantly, right from your browser.