PanguBot Disallow

PanguBot Disallow tracking and usage

Websites using PanguBot Disallow by countrymarket share
23%
๐Ÿ‡บ๐Ÿ‡ธUS
12%
๐Ÿ‡ฉ๐Ÿ‡ชDE
8%
๐Ÿ‡ฌ๐Ÿ‡งGB
5.8%
๐Ÿ‡จ๐Ÿ‡ญCH
4.3%
๐Ÿ‡ช๐Ÿ‡ธES
4.1%
๐Ÿ‡ธ๐Ÿ‡ชSE
3.2%
๐Ÿ‡ซ๐Ÿ‡ทFR
2.5%
๐Ÿ‡ณ๐Ÿ‡ฑNL
Websites using PanguBot Disallow by industrymarket share ยท top 6 industries
News & Weather
32%
Shopping
16%
Education
15%
Technology & Computing
14%
Print & Publishing
12%
SaaS & Cloud
11%
0%10%20%30%40%
Download report

We track 10,442 websites using PanguBot Disallow, along with their country, traffic, industry and platforms. There are 2,445 websites using PanguBot Disallow in United States.

Filter by country
๐Ÿ‡บ๐Ÿ‡ธ United States2,445 sites
๐Ÿ‡ฉ๐Ÿ‡ช Germany1,206 sites
๐Ÿ‡ฌ๐Ÿ‡ง United Kingdom840 sites
๐Ÿ‡จ๐Ÿ‡ญ Switzerland610 sites
๐Ÿ‡ช๐Ÿ‡ธ Spain454 sites
๐Ÿ‡ธ๐Ÿ‡ช Sweden427 sites
๐Ÿ‡ซ๐Ÿ‡ท France335 sites
๐Ÿ‡ณ๐Ÿ‡ฑ Netherlands264 sites
๐Ÿ‡ต๐Ÿ‡ฑ Poland245 sites
๐Ÿ‡ณ๐Ÿ‡ด Norway242 sites
๐Ÿ‡จ๐Ÿ‡ฆ Canada227 sites
๐Ÿ‡ง๐Ÿ‡ท Brazil181 sites
๐Ÿ‡ฎ๐Ÿ‡น Italy144 sites
๐Ÿ‡ซ๐Ÿ‡ฎ Finland140 sites
๐Ÿ‡ฉ๐Ÿ‡ฐ Denmark127 sites
๐Ÿ‡ฆ๐Ÿ‡น Austria95 sites
๐Ÿ‡ฆ๐Ÿ‡บ Australia87 sites
๐Ÿ‡ฎ๐Ÿ‡ช Ireland79 sites
๐Ÿ‡ง๐Ÿ‡ช Belgium74 sites
๐Ÿ‡ณ๐Ÿ‡ฟ New Zealand64 sites
๐Ÿ‡ฎ๐Ÿ‡ณ India51 sites
๐Ÿ‡ฌ๐Ÿ‡ท Greece41 sites
๐Ÿ‡ธ๐Ÿ‡ฐ Slovakia40 sites
๐Ÿ‡จ๐Ÿ‡ฟ Czechia37 sites
๐Ÿ‡ฒ๐Ÿ‡ฝ Mexico29 sites
๐Ÿ‡ฟ๐Ÿ‡ฆ South Africa28 sites
๐Ÿ‡ฏ๐Ÿ‡ต Japan26 sites
๐Ÿ‡ญ๐Ÿ‡บ Hungary24 sites
๐Ÿ‡บ๐Ÿ‡ฆ Ukraine24 sites
๐Ÿ‡ต๐Ÿ‡น Portugal22 sites
๐Ÿ‡น๐Ÿ‡ท Turkey22 sites
๐Ÿ‡ฆ๐Ÿ‡ช United Arab Emirates20 sites
๐Ÿ‡ช๐Ÿ‡ช Estonia19 sites
๐Ÿ‡ฑ๐Ÿ‡น Lithuania19 sites
๐Ÿ‡ท๐Ÿ‡บ Russian Federation19 sites
๐Ÿ‡ฆ๐Ÿ‡ท Argentina18 sites
๐Ÿ‡ฐ๐Ÿ‡ท Korea, Republic of18 sites
๐Ÿ‡ธ๐Ÿ‡ฎ Slovenia17 sites
๐Ÿ‡จ๐Ÿ‡ณ China14 sites
๐Ÿ‡จ๐Ÿ‡ฑ Chile13 sites
๐Ÿ‡ธ๐Ÿ‡ฌ Singapore13 sites
๐Ÿ‡ท๐Ÿ‡ด Romania12 sites
๐Ÿ‡ฎ๐Ÿ‡ฉ Indonesia9 sites
๐Ÿ‡ฒ๐Ÿ‡จ Monaco9 sites
๐Ÿ‡ป๐Ÿ‡ณ Viet Nam8 sites
๐Ÿ‡ฒ๐Ÿ‡พ Malaysia7 sites
๐Ÿ‡จ๐Ÿ‡ด Colombia6 sites
๐Ÿ‡ญ๐Ÿ‡ฐ Hong Kong6 sites
๐Ÿ‡ธ๐Ÿ‡ฆ Saudi Arabia6 sites
๐Ÿ‡ง๐Ÿ‡ฆ Bosnia and Herzegovina5 sites
๐Ÿ‡ช๐Ÿ‡ฌ Egypt5 sites
๐Ÿ‡จ๐Ÿ‡พ Cyprus5 sites
๐Ÿ‡ฑ๐Ÿ‡บ Luxembourg5 sites
๐Ÿ‡ง๐Ÿ‡ฌ Bulgaria4 sites
๐Ÿ‡ฎ๐Ÿ‡ธ Iceland4 sites
๐Ÿ‡ฐ๐Ÿ‡ช Kenya4 sites
๐Ÿ‡ต๐Ÿ‡ฐ Pakistan4 sites
๐Ÿ‡ฉ๐Ÿ‡ด Dominican Republic4 sites
๐Ÿ‡น๐Ÿ‡ผ Taiwan, Province of China4 sites
๐Ÿ‡ง๐Ÿ‡พ Belarus4 sites
๐Ÿ‡ฑ๐Ÿ‡ป Latvia3 sites
๐Ÿ‡ท๐Ÿ‡ธ Serbia3 sites
๐Ÿ‡ง๐Ÿ‡ฉ Bangladesh3 sites
๐Ÿ‡ฎ๐Ÿ‡ฑ Israel3 sites
๐Ÿ‡ต๐Ÿ‡ช Peru3 sites
๐Ÿ‡ณ๐Ÿ‡ฌ Nigeria3 sites
๐Ÿ‡ฆ๐Ÿ‡ฌ Antigua and Barbuda3 sites
๐Ÿ‡จ๐Ÿ‡ท Costa Rica3 sites
๐Ÿ‡น๐Ÿ‡ญ Thailand3 sites
๐Ÿ‡ฆ๐Ÿ‡ธ American Samoa3 sites
๐Ÿ‡ฌ๐Ÿ‡น Guatemala3 sites
๐Ÿ‡ฑ๐Ÿ‡ฎ Liechtenstein3 sites
๐Ÿ‡ฆ๐Ÿ‡ฉ Andorra2 sites
๐Ÿ‡ช๐Ÿ‡จ Ecuador2 sites
๐Ÿ‡ฑ๐Ÿ‡ฐ Sri Lanka2 sites
๐Ÿ‡ต๐Ÿ‡ญ Philippines2 sites
๐Ÿ‡บ๐Ÿ‡ฌ Uganda2 sites
๐Ÿ‡บ๐Ÿ‡พ Uruguay2 sites
๐Ÿ‡ฎ๐Ÿ‡ท Iran, Islamic Republic of2 sites
๐Ÿ‡จ๐Ÿ‡ฎ Cรดte d'Ivoire2 sites
๐Ÿ‡ญ๐Ÿ‡ท Croatia2 sites
๐Ÿ‡ถ๐Ÿ‡ฆ Qatar2 sites
๐Ÿ‡ฒ๐Ÿ‡บ Mauritius2 sites
๐Ÿ‡ฒ๐Ÿ‡ฆ Morocco2 sites
๐Ÿ‡ฒ๐Ÿ‡ฉ Moldova, Republic of1 sites
๐Ÿ‡จ๐Ÿ‡ผ Curaรงao1 sites
๐Ÿ‡ฌ๐Ÿ‡ฉ Grenada1 sites
๐Ÿ‡ณ๐Ÿ‡ฆ Namibia1 sites
๐Ÿ‡ซ๐Ÿ‡ฏ Fiji1 sites
๐Ÿ‡ธ๐Ÿ‡ป El Salvador1 sites
๐Ÿ‡ฒ๐Ÿ‡ช Montenegro1 sites
๐Ÿ‡จ๐Ÿ‡ฒ Cameroon1 sites
๐Ÿ‡บ๐Ÿ‡ฟ Uzbekistan1 sites
๐Ÿ‡ฎ๐Ÿ‡ด British Indian Ocean Territory1 sites
๐Ÿ‡ต๐Ÿ‡ท Puerto Rico1 sites
๐Ÿ‡ฌ๐Ÿ‡ญ Ghana1 sites
๐Ÿ‡ฐ๐Ÿ‡ผ Kuwait1 sites
๐Ÿ‡ฑ๐Ÿ‡ธ Lesotho1 sites
๐Ÿ‡ฒ๐Ÿ‡ณ Mongolia1 sites
๐Ÿ‡ฎ๐Ÿ‡ฒ Isle of Man1 sites
๐Ÿ‡ฎ๐Ÿ‡ถ Iraq1 sites
๐Ÿ‡ฐ๐Ÿ‡ฟ Kazakhstan1 sites
๐Ÿ‡ท๐Ÿ‡ช Rรฉunion1 sites
๐Ÿ‡ฒ๐Ÿ‡ฐ North Macedonia1 sites
๐Ÿ‡ง๐Ÿ‡ฟ Belize1 sites
๐Ÿ‡ณ๐Ÿ‡ฎ Nicaragua1 sites

About PanguBot Disallow

Sites blocking the PanguBot crawler in robots.txt.

Websites using PanguBot Disallow

showing 25 of 10,442
WebsiteCountryTrafficIndustry
amazon.co.jp๐Ÿ‡ฏ๐Ÿ‡ตJPTop 500Shopping
spiegel.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 500Print & Publishing
usnews.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500Technology & Computing
lemonde.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 500News & Weather
amazon.co.uk๐Ÿ‡ฌ๐Ÿ‡งGBTop 500Entertainment
amazon.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 500Logistics & Shipping
amazon.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 500Logistics & Shipping
cnn.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500News & Weather
launchpad.net๐Ÿ‡ฌ๐Ÿ‡งGBTop 500Mental Health
behance.net๐Ÿ‡บ๐Ÿ‡ธUSTop 500Technology & Computing
lesechos.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 1KNews & Weather
wired.co.uk๐Ÿ‡ฌ๐Ÿ‡งGBTop 1KSoftware Development
slate.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KPrint & Publishing
amazon.it๐Ÿ‡ฎ๐Ÿ‡นITTop 1KShopping
crunchbase.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KSoftware Development
welt.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 1KNews & Weather
ouest-france.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 1KNews & Weather
amazon.es๐Ÿ‡ช๐Ÿ‡ธESTop 1KTechnology & Computing
amazon.com.au๐Ÿ‡ฆ๐Ÿ‡บAUTop 1KShopping
wired.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KTechnology & Computing
bild.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 1KNews & Weather
amazon.ca๐Ÿ‡จ๐Ÿ‡ฆCATop 1KLogistics & Shipping
amazon.in๐Ÿ‡ฎ๐Ÿ‡ณINTop 1KShopping
dailymail.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KPrint & Publishing
repubblica.it๐Ÿ‡ฎ๐Ÿ‡นITTop 1KNews & Weather
Showing 25 of 10,442 websitesView detailed list โ†’