ICC-Crawler Disallow tracking and usage
Websites using ICC-Crawler Disallow by countrymarket share
36%
🇺🇸US11%
🇩🇪DE5.1%
🇬🇧GB3.4%
🇨🇭CH3.2%
🇸🇪SE2.3%
🇪🇸ES2.2%
🇫🇷FR2.2%
🇯🇵JPWebsites using ICC-Crawler Disallow by industrymarket share · top 6 industries
News & Weather
Print & Publishing
Shopping
Technology & Computing
SaaS & Cloud
Sports
0%13%25%38%50%
Download report
We track 9,537 websites using ICC-Crawler Disallow, along with their country, traffic, industry and platforms. There are 3,433 websites using ICC-Crawler Disallow in United States.
Filter by country
🇺🇸 United States3,433 sites
🇩🇪 Germany1,015 sites
🇬🇧 United Kingdom488 sites
🇨🇭 Switzerland320 sites
🇸🇪 Sweden307 sites
🇪🇸 Spain218 sites
🇫🇷 France212 sites
🇯🇵 Japan209 sites
🇨🇦 Canada186 sites
🇳🇴 Norway180 sites
🇵🇱 Poland141 sites
🇳🇱 Netherlands138 sites
🇧🇷 Brazil90 sites
🇮🇹 Italy89 sites
🇫🇮 Finland88 sites
🇦🇺 Australia60 sites
🇦🇹 Austria58 sites
🇩🇰 Denmark58 sites
🇮🇳 India41 sites
🇮🇪 Ireland36 sites
🇲🇨 Monaco35 sites
🇧🇪 Belgium34 sites
🇬🇷 Greece26 sites
🇷🇺 Russian Federation20 sites
🇨🇿 Czechia19 sites
🇳🇿 New Zealand18 sites
🇵🇹 Portugal17 sites
🇦🇷 Argentina16 sites
🇭🇺 Hungary15 sites
🇲🇽 Mexico15 sites
🇰🇷 Korea, Republic of14 sites
🇿🇦 South Africa14 sites
🇨🇳 China13 sites
🇮🇩 Indonesia13 sites
🇸🇰 Slovakia13 sites
🇱🇹 Lithuania12 sites
🇻🇳 Viet Nam11 sites
🇺🇦 Ukraine11 sites
🇦🇪 United Arab Emirates10 sites
🇸🇬 Singapore10 sites
🇸🇮 Slovenia10 sites
🇹🇼 Taiwan, Province of China10 sites
🇷🇴 Romania9 sites
🇨🇱 Chile8 sites
🇵🇷 Puerto Rico8 sites
🇹🇷 Turkey8 sites
🇧🇾 Belarus8 sites
🇰🇿 Kazakhstan7 sites
🇲🇾 Malaysia6 sites
🇸🇦 Saudi Arabia6 sites
🇪🇬 Egypt6 sites
🇪🇪 Estonia5 sites
🇮🇷 Iran, Islamic Republic of5 sites
🇵🇦 Panama5 sites
🇸🇻 El Salvador5 sites
🇲🇦 Morocco5 sites
🇨🇾 Cyprus5 sites
🇧🇬 Bulgaria5 sites
🇵🇭 Philippines5 sites
🇨🇴 Colombia4 sites
🇰🇪 Kenya4 sites
🇺🇾 Uruguay4 sites
🇬🇭 Ghana4 sites
🇹🇭 Thailand4 sites
🇨🇷 Costa Rica4 sites
🇧🇸 Bahamas3 sites
🇪🇨 Ecuador3 sites
🇭🇷 Croatia3 sites
🇷🇸 Serbia3 sites
🇧🇩 Bangladesh3 sites
🇮🇸 Iceland3 sites
🇨🇮 Côte d'Ivoire3 sites
🇳🇬 Nigeria3 sites
🇱🇺 Luxembourg3 sites
🇱🇮 Liechtenstein3 sites
🇩🇴 Dominican Republic3 sites
🇵🇪 Peru3 sites
🇬🇹 Guatemala3 sites
🇳🇦 Namibia2 sites
🇭🇳 Honduras2 sites
🇶🇦 Qatar2 sites
🇫🇯 Fiji2 sites
🇦🇬 Antigua and Barbuda2 sites
🇹🇹 Trinidad and Tobago2 sites
🇦🇽 Åland Islands2 sites
🇦🇸 American Samoa2 sites
🇦🇩 Andorra1 sites
🇭🇹 Haiti1 sites
🇰🇭 Cambodia1 sites
🇱🇰 Sri Lanka1 sites
🇱🇻 Latvia1 sites
🇵🇰 Pakistan1 sites
🇧🇳 Brunei Darussalam1 sites
🇯🇴 Jordan1 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇺🇬 Uganda1 sites
🇨🇼 Curaçao1 sites
🇬🇬 Guernsey1 sites
🇬🇩 Grenada1 sites
🇧🇭 Bahrain1 sites
🇮🇱 Israel1 sites
🇹🇯 Tajikistan1 sites
🇺🇿 Uzbekistan1 sites
🇰🇬 Kyrgyzstan1 sites
🇹🇳 Tunisia1 sites
🇨🇲 Cameroon1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇷🇪 Réunion1 sites
🇲🇩 Moldova, Republic of1 sites
🇬🇺 Guam1 sites
🇲🇵 Northern Mariana Islands1 sites
🇻🇮 Virgin Islands, U.S.1 sites
🇻🇺 Vanuatu1 sites
🇦🇱 Albania1 sites
🇧🇿 Belize1 sites
🇧🇴 Bolivia, Plurinational State of1 sites
🇭🇰 Hong Kong1 sites
🇲🇳 Mongolia1 sites
🇳🇮 Nicaragua1 sites
🇵🇾 Paraguay1 sites
🇵🇸 Palestine, State of1 sites
🇵🇫 French Polynesia1 sites
🇸🇧 Solomon Islands1 sites
🇻🇪 Venezuela, Bolivarian Republic of1 sites
🇼🇸 Samoa1 sites
About ICC-Crawler Disallow
This website has found the Disallow rules for ICC-Crawler.
Categories
Official website
www.nict.go.jp/en/univ-com/plan/crawl.html↗
Websites using ICC-Crawler Disallow
showing 25 of 9,537| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.co.jp | 🇯🇵JP | Top 500 | Shopping |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇫🇷FR | Top 500 | News & Weather | |
 amazon.co.uk | 🇬🇧GB | Top 500 | Entertainment |
 amazon.fr | 🇫🇷FR | Top 500 | Logistics & Shipping |
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇺🇸US | Top 500 | Entertainment | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | Mental Health | |
| 🇦🇺AU | Top 500 | Software Development | |
| 🇫🇷FR | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Print & Publishing | |
 amazon.it | 🇮🇹IT | Top 1K | Shopping |
| 🇩🇪DE | Top 1K | News & Weather | |
| 🇫🇷FR | Top 1K | News & Weather | |
| 🇰🇪KE | Top 1K | Law & Government | |
 amazon.es | 🇪🇸ES | Top 1K | Technology & Computing |
 amazon.com.au | 🇦🇺AU | Top 1K | Shopping |
| 🇺🇸US | Top 1K | Technology & Computing | |
| 🇩🇪DE | Top 1K | News & Weather | |
 amazon.ca | 🇨🇦CA | Top 1K | Logistics & Shipping |
| 🇺🇸US | Top 1K | News & Weather | |
 amazon.in | 🇮🇳IN | Top 1K | Shopping |
| 🇺🇸US | Top 1K | Print & Publishing | |
| 🇺🇸US | Top 1K | Gaming |
Showing 25 of 9,537 websitesView detailed list →
