OAI-SearchBot Disallow tracking and usage
Websites using OAI-SearchBot Disallow by countrymarket share
26%
🇺🇸US9.3%
🇬🇧GB5.4%
🇩🇪DE3.3%
🇫🇷FR3.1%
🇳🇱NL2.9%
🇪🇸ES2.5%
🇨🇭CH2.3%
🇨🇦CAWebsites using OAI-SearchBot Disallow by industrymarket share · top 6 industries
News & Weather
Education
SaaS & Cloud
Shopping
Print & Publishing
Technology & Computing
0%13%25%38%50%
Download report
We track 14,804 websites using OAI-SearchBot Disallow, along with their country, traffic, industry and platforms. There are 3,902 websites using OAI-SearchBot Disallow in United States.
Filter by country
🇺🇸 United States3,902 sites
🇬🇧 United Kingdom1,372 sites
🇩🇪 Germany805 sites
🇫🇷 France492 sites
🇳🇱 Netherlands465 sites
🇪🇸 Spain435 sites
🇨🇭 Switzerland373 sites
🇨🇦 Canada343 sites
🇸🇪 Sweden302 sites
🇳🇴 Norway301 sites
🇧🇷 Brazil285 sites
🇮🇹 Italy245 sites
🇧🇪 Belgium229 sites
🇦🇺 Australia215 sites
🇯🇵 Japan203 sites
🇫🇮 Finland181 sites
🇵🇱 Poland149 sites
🇩🇰 Denmark144 sites
🇮🇳 India135 sites
🇨🇿 Czechia85 sites
🇷🇺 Russian Federation71 sites
🇨🇳 China69 sites
🇦🇹 Austria65 sites
🇰🇷 Korea, Republic of54 sites
🇹🇷 Turkey46 sites
🇮🇪 Ireland44 sites
🇦🇷 Argentina41 sites
🇺🇦 Ukraine41 sites
🇬🇷 Greece40 sites
🇳🇿 New Zealand39 sites
🇵🇹 Portugal33 sites
🇨🇱 Chile31 sites
🇿🇦 South Africa31 sites
🇮🇩 Indonesia30 sites
🇭🇺 Hungary29 sites
🇷🇴 Romania23 sites
🇲🇽 Mexico22 sites
🇭🇰 Hong Kong16 sites
🇪🇬 Egypt16 sites
🇸🇬 Singapore16 sites
🇸🇰 Slovakia16 sites
🇹🇭 Thailand14 sites
🇮🇱 Israel13 sites
🇱🇹 Lithuania13 sites
🇻🇳 Viet Nam13 sites
🇱🇺 Luxembourg13 sites
🇲🇾 Malaysia13 sites
🇻🇪 Venezuela, Bolivarian Republic of13 sites
🇦🇪 United Arab Emirates12 sites
🇱🇻 Latvia12 sites
🇸🇮 Slovenia12 sites
🇪🇪 Estonia11 sites
🇵🇪 Peru11 sites
🇨🇴 Colombia10 sites
🇹🇼 Taiwan, Province of China9 sites
🇧🇬 Bulgaria8 sites
🇵🇭 Philippines8 sites
🇸🇦 Saudi Arabia8 sites
🇵🇰 Pakistan8 sites
🇭🇷 Croatia7 sites
🇲🇦 Morocco7 sites
🇲🇹 Malta7 sites
🇳🇬 Nigeria7 sites
🇰🇪 Kenya7 sites
🇵🇷 Puerto Rico7 sites
🇰🇿 Kazakhstan6 sites
🇶🇦 Qatar6 sites
🇧🇾 Belarus6 sites
🇷🇸 Serbia5 sites
🇮🇸 Iceland5 sites
🇮🇷 Iran, Islamic Republic of5 sites
🇨🇷 Costa Rica5 sites
🇧🇸 Bahamas4 sites
🇧🇩 Bangladesh4 sites
🇯🇴 Jordan3 sites
🇸🇻 El Salvador3 sites
🇨🇮 Côte d'Ivoire3 sites
🇸🇱 Sierra Leone3 sites
🇬🇭 Ghana3 sites
🇷🇪 Réunion3 sites
🇱🇮 Liechtenstein3 sites
🇪🇨 Ecuador2 sites
🇺🇬 Uganda2 sites
🇺🇾 Uruguay2 sites
🇳🇦 Namibia2 sites
🇨🇾 Cyprus2 sites
🇹🇳 Tunisia2 sites
🇦🇿 Azerbaijan2 sites
🇸🇨 Seychelles2 sites
🇱🇧 Lebanon2 sites
🇲🇰 North Macedonia2 sites
🇹🇹 Trinidad and Tobago2 sites
🇴🇲 Oman2 sites
🇬🇦 Gabon1 sites
🇱🇰 Sri Lanka1 sites
🇽🇰 Kosovo1 sites
🇬🇱 Greenland1 sites
🇭🇹 Haiti1 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇨🇼 Curaçao1 sites
🇬🇵 Guadeloupe1 sites
🇲🇺 Mauritius1 sites
🇫🇯 Fiji1 sites
🇵🇾 Paraguay1 sites
🇧🇴 Bolivia, Plurinational State of1 sites
🇬🇾 Guyana1 sites
🇭🇳 Honduras1 sites
🇻🇨 Saint Vincent and the Grenadines1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇨🇽 Christmas Island1 sites
🇬🇲 Gambia1 sites
🇩🇴 Dominican Republic1 sites
🇬🇺 Guam1 sites
🇰🇬 Kyrgyzstan1 sites
🇲🇵 Northern Mariana Islands1 sites
🇲🇸 Montserrat1 sites
🇹🇬 Togo1 sites
🇻🇮 Virgin Islands, U.S.1 sites
🇻🇺 Vanuatu1 sites
🇦🇸 American Samoa1 sites
🇬🇹 Guatemala1 sites
🇰🇳 Saint Kitts and Nevis1 sites
🇲🇳 Mongolia1 sites
🇷🇼 Rwanda1 sites
🇦🇫 Afghanistan1 sites
🇮🇲 Isle of Man1 sites
🇮🇶 Iraq1 sites
🇲🇬 Madagascar1 sites
🇸🇴 Somalia1 sites
🇦🇩 Andorra1 sites
🇦🇲 Armenia1 sites
🇩🇿 Algeria1 sites
🇯🇲 Jamaica1 sites
🇳🇵 Nepal1 sites
🇲🇩 Moldova, Republic of0 sites
About OAI-SearchBot Disallow
Sites blocking the OAI-SearchBot crawler in robots.txt.
Categories
Websites using OAI-SearchBot Disallow
showing 25 of 14,804| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.co.jp | 🇯🇵JP | Top 500 | Shopping |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇩🇪DE | Top 500 | Print & Publishing | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | News & Weather | |
 amazon.co.uk | 🇬🇧GB | Top 500 | Entertainment |
 amazon.fr | 🇫🇷FR | Top 500 | Logistics & Shipping |
| 🇺🇸US | Top 500 | News & Weather | |
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇩🇪DE | Top 500 | Entertainment | |
| 🇨🇳CN | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Science | |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇬🇧GB | Top 500 | Mental Health | |
| 🇫🇷FR | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Print & Publishing | |
 amazon.it | 🇮🇹IT | Top 1K | Shopping |
| 🇺🇸US | Top 1K | News & Weather |
Showing 25 of 14,804 websitesView detailed list →
