archive.org bot Disallow

archive.org bot Disallow tracking and usage

Websites using archive.org bot Disallow by countrymarket share
17%
๐Ÿ‡บ๐Ÿ‡ธUS
8.3%
๐Ÿ‡ฆ๐Ÿ‡บAU
6.7%
๐Ÿ‡น๐Ÿ‡ทTR
5.5%
๐Ÿ‡ฉ๐Ÿ‡ชDE
4.9%
๐Ÿ‡ฌ๐Ÿ‡งGB
4%
๐Ÿ‡ณ๐Ÿ‡ฑNL
3.1%
๐Ÿ‡ช๐Ÿ‡ธES
3%
๐Ÿ‡ฎ๐Ÿ‡นIT
Websites using archive.org bot Disallow by industrymarket share ยท top 6 industries
News & Weather
22%
Shopping
21%
Education
18%
Technology & Computing
14%
SaaS & Cloud
13%
Law & Government
12%
0%6.3%13%19%25%
Filter by country
๐Ÿ‡บ๐Ÿ‡ธ United States2,249 sites
๐Ÿ‡ฆ๐Ÿ‡บ Australia1,108 sites
๐Ÿ‡น๐Ÿ‡ท Turkey894 sites
๐Ÿ‡ฉ๐Ÿ‡ช Germany738 sites
๐Ÿ‡ฌ๐Ÿ‡ง United Kingdom647 sites
๐Ÿ‡ณ๐Ÿ‡ฑ Netherlands529 sites
๐Ÿ‡ช๐Ÿ‡ธ Spain409 sites
๐Ÿ‡ฎ๐Ÿ‡น Italy393 sites
๐Ÿ‡ซ๐Ÿ‡ท France389 sites
๐Ÿ‡ท๐Ÿ‡บ Russian Federation371 sites
๐Ÿ‡ต๐Ÿ‡ฑ Poland369 sites
๐Ÿ‡จ๐Ÿ‡ฆ Canada247 sites
๐Ÿ‡ธ๐Ÿ‡ช Sweden196 sites
๐Ÿ‡ง๐Ÿ‡ท Brazil176 sites
๐Ÿ‡จ๐Ÿ‡ญ Switzerland171 sites
๐Ÿ‡ฎ๐Ÿ‡ณ India156 sites
๐Ÿ‡ซ๐Ÿ‡ฎ Finland134 sites
๐Ÿ‡ฆ๐Ÿ‡น Austria130 sites
๐Ÿ‡จ๐Ÿ‡ฟ Czechia103 sites
๐Ÿ‡ฟ๐Ÿ‡ฆ South Africa82 sites
๐Ÿ‡ธ๐Ÿ‡ฆ Saudi Arabia80 sites
๐Ÿ‡ฉ๐Ÿ‡ฐ Denmark77 sites
๐Ÿ‡ท๐Ÿ‡ผ Rwanda67 sites
๐Ÿ‡ฌ๐Ÿ‡ท Greece65 sites
๐Ÿ‡ณ๐Ÿ‡ฟ New Zealand62 sites
๐Ÿ‡ป๐Ÿ‡ณ Viet Nam51 sites
๐Ÿ‡ง๐Ÿ‡ช Belgium46 sites
๐Ÿ‡ช๐Ÿ‡ช Estonia46 sites
๐Ÿ‡ฎ๐Ÿ‡ฉ Indonesia44 sites
๐Ÿ‡ต๐Ÿ‡น Portugal44 sites
๐Ÿ‡ท๐Ÿ‡ด Romania42 sites
๐Ÿ‡ญ๐Ÿ‡บ Hungary40 sites
๐Ÿ‡บ๐Ÿ‡ฆ Ukraine39 sites
๐Ÿ‡ฏ๐Ÿ‡ต Japan38 sites
๐Ÿ‡ณ๐Ÿ‡ด Norway34 sites
๐Ÿ‡จ๐Ÿ‡ณ China32 sites
๐Ÿ‡น๐Ÿ‡ญ Thailand30 sites
๐Ÿ‡ฒ๐Ÿ‡ฝ Mexico26 sites
๐Ÿ‡ฎ๐Ÿ‡ท Iran, Islamic Republic of26 sites
๐Ÿ‡ฆ๐Ÿ‡ช United Arab Emirates22 sites
๐Ÿ‡ฐ๐Ÿ‡ท Korea, Republic of21 sites
๐Ÿ‡ธ๐Ÿ‡ฐ Slovakia17 sites
๐Ÿ‡ฑ๐Ÿ‡ป Latvia17 sites
๐Ÿ‡ง๐Ÿ‡ฌ Bulgaria15 sites
๐Ÿ‡ง๐Ÿ‡พ Belarus15 sites
๐Ÿ‡ธ๐Ÿ‡ฌ Singapore14 sites
๐Ÿ‡ฆ๐Ÿ‡ท Argentina13 sites
๐Ÿ‡ฎ๐Ÿ‡ฑ Israel11 sites
๐Ÿ‡ท๐Ÿ‡ธ Serbia11 sites
๐Ÿ‡จ๐Ÿ‡ด Colombia9 sites
๐Ÿ‡ฎ๐Ÿ‡ช Ireland9 sites
๐Ÿ‡น๐Ÿ‡ผ Taiwan, Province of China8 sites
๐Ÿ‡ญ๐Ÿ‡ฐ Hong Kong7 sites
๐Ÿ‡ฑ๐Ÿ‡น Lithuania7 sites
๐Ÿ‡ฑ๐Ÿ‡บ Luxembourg7 sites
๐Ÿ‡ฒ๐Ÿ‡น Malta7 sites
๐Ÿ‡ฆ๐Ÿ‡ฟ Azerbaijan7 sites
๐Ÿ‡ต๐Ÿ‡ฐ Pakistan7 sites
๐Ÿ‡ฒ๐Ÿ‡พ Malaysia7 sites
๐Ÿ‡จ๐Ÿ‡ฑ Chile7 sites
๐Ÿ‡ฐ๐Ÿ‡ฟ Kazakhstan7 sites
๐Ÿ‡ช๐Ÿ‡ฌ Egypt6 sites
๐Ÿ‡ง๐Ÿ‡ฆ Bosnia and Herzegovina5 sites
๐Ÿ‡ต๐Ÿ‡ญ Philippines5 sites
๐Ÿ‡ฐ๐Ÿ‡ช Kenya5 sites
๐Ÿ‡ถ๐Ÿ‡ฆ Qatar5 sites
๐Ÿ‡ญ๐Ÿ‡ท Croatia4 sites
๐Ÿ‡บ๐Ÿ‡พ Uruguay4 sites
๐Ÿ‡จ๐Ÿ‡พ Cyprus4 sites
๐Ÿ‡ป๐Ÿ‡จ Saint Vincent and the Grenadines4 sites
๐Ÿ‡ฑ๐Ÿ‡ฎ Liechtenstein4 sites
๐Ÿ‡ป๐Ÿ‡ช Venezuela, Bolivarian Republic of3 sites
๐Ÿ‡ช๐Ÿ‡จ Ecuador3 sites
๐Ÿ‡ต๐Ÿ‡ช Peru3 sites
๐Ÿ‡ฏ๐Ÿ‡ด Jordan3 sites
๐Ÿ‡ฆ๐Ÿ‡ฉ Andorra3 sites
๐Ÿ‡จ๐Ÿ‡ผ Curaรงao3 sites
๐Ÿ‡ฒ๐Ÿ‡จ Monaco2 sites
๐Ÿ‡ด๐Ÿ‡ฒ Oman2 sites
๐Ÿ‡ง๐Ÿ‡ฉ Bangladesh2 sites
๐Ÿ‡ธ๐Ÿ‡ด Somalia2 sites
๐Ÿ‡ฉ๐Ÿ‡ด Dominican Republic2 sites
๐Ÿ‡ฒ๐Ÿ‡ฐ North Macedonia2 sites
๐Ÿ‡ธ๐Ÿ‡ฎ Slovenia2 sites
๐Ÿ‡ฒ๐Ÿ‡ฒ Myanmar2 sites
๐Ÿ‡ต๐Ÿ‡ซ French Polynesia1 sites
๐Ÿ‡จ๐Ÿ‡ท Costa Rica1 sites
๐Ÿ‡ฆ๐Ÿ‡ฒ Armenia1 sites
๐Ÿ‡บ๐Ÿ‡ฌ Uganda1 sites
๐Ÿ‡น๐Ÿ‡ฏ Tajikistan1 sites
๐Ÿ‡ญ๐Ÿ‡ณ Honduras1 sites
๐Ÿ‡ฒ๐Ÿ‡บ Mauritius1 sites
๐Ÿ‡ฌ๐Ÿ‡ช Georgia1 sites
๐Ÿ‡ธ๐Ÿ‡ณ Senegal1 sites
๐Ÿ‡บ๐Ÿ‡ฟ Uzbekistan1 sites
๐Ÿ‡ฐ๐Ÿ‡ฌ Kyrgyzstan1 sites
๐Ÿ‡ง๐Ÿ‡ฒ Bermuda1 sites
๐Ÿ‡ธ๐Ÿ‡ท Suriname1 sites
๐Ÿ‡จ๐Ÿ‡ฌ Congo1 sites
๐Ÿ‡ฑ๐Ÿ‡ฐ Sri Lanka1 sites
๐Ÿ‡ฐ๐Ÿ‡ผ Kuwait1 sites
๐Ÿ‡น๐Ÿ‡ณ Tunisia1 sites
๐Ÿ‡ณ๐Ÿ‡ฌ Nigeria1 sites
๐Ÿ‡จ๐Ÿ‡ฒ Cameroon1 sites
๐Ÿ‡ฐ๐Ÿ‡พ Cayman Islands1 sites
๐Ÿ‡ป๐Ÿ‡ฌ Virgin Islands, British1 sites
๐Ÿ‡ฆ๐Ÿ‡ธ American Samoa1 sites
๐Ÿ‡ฆ๐Ÿ‡ฌ Antigua and Barbuda1 sites
๐Ÿ‡ง๐Ÿ‡ฟ Belize1 sites
๐Ÿ‡ฌ๐Ÿ‡ฑ Greenland1 sites
๐Ÿ‡ต๐Ÿ‡ผ Palau1 sites
๐Ÿ‡ธ๐Ÿ‡ฝ Sint Maarten (Dutch part)1 sites
๐Ÿ‡ง๐Ÿ‡ฏ Benin1 sites
๐Ÿ‡ณ๐Ÿ‡ต Nepal1 sites
๐Ÿ‡ฒ๐Ÿ‡ฉ Moldova, Republic of1 sites
๐Ÿ‡ฒ๐Ÿ‡ฌ Madagascar1 sites
๐Ÿ‡ฒ๐Ÿ‡ฟ Mozambique1 sites
๐Ÿ‡ฐ๐Ÿ‡ญ Cambodia1 sites
๐Ÿ‡ฒ๐Ÿ‡ฆ Morocco1 sites
๐Ÿ‡ณ๐Ÿ‡ฎ Nicaragua1 sites
๐Ÿ‡ต๐Ÿ‡ท Puerto Rico1 sites
๐Ÿ‡น๐Ÿ‡ฟ Tanzania, United Republic of1 sites

About archive.org bot Disallow

This website has found the Disallow rules for archive.org bot.

Websites using archive.org bot Disallow

showing 25 of 13,299
WebsiteCountryTrafficIndustry
nbcnews.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500News & Weather
washingtonpost.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500News & Weather
spiegel.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 500Print & Publishing
lemonde.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 500News & Weather
nytimes.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500News & Weather
cnn.com๐Ÿ‡บ๐Ÿ‡ธUSTop 500News & Weather
lesechos.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 1KNews & Weather
wired.co.uk๐Ÿ‡ฌ๐Ÿ‡งGBTop 1KSoftware Development
wired.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KTechnology & Computing
theatlantic.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KPrint & Publishing
dailymail.com๐Ÿ‡บ๐Ÿ‡ธUSTop 1KPrint & Publishing
repubblica.it๐Ÿ‡ฎ๐Ÿ‡นITTop 1KNews & Weather
elpais.com๐Ÿ‡ช๐Ÿ‡ธESTop 1KNews & Weather
dailymail.co.uk๐Ÿ‡ฌ๐Ÿ‡งGBTop 1KNews & Weather
mlive.com๐Ÿ‡บ๐Ÿ‡ธUSTop 5KNews & Weather
nj.com๐Ÿ‡บ๐Ÿ‡ธUSTop 5KNews & Weather
al.com-Top 5KEntertainment
self.com๐Ÿ‡บ๐Ÿ‡ธUSTop 5KPrint & Publishing
morgenpost.de๐Ÿ‡ฉ๐Ÿ‡ชDETop 5KNews & Weather
dejure.org๐Ÿ‡ฉ๐Ÿ‡ชDETop 5KTechnology & Computing
fd.nl๐Ÿ‡ณ๐Ÿ‡ฑNLTop 5KNews & Weather
pitchfork.com๐Ÿ‡บ๐Ÿ‡ธUSTop 5KMusic
news24.com-Top 5KMovies & TV
telerama.fr๐Ÿ‡ซ๐Ÿ‡ทFRTop 5KNews & Weather
lastampa.it๐Ÿ‡ฎ๐Ÿ‡นITTop 5KNews & Weather
Showing 25 of 13,299 websitesView detailed list โ†’