OAI-SearchBot Disallow tracking and usage
Websites using OAI-SearchBot Disallow by countrymarket share
37%
🇺🇸US8.2%
🇬🇧GB5.6%
🇩🇪DE2.9%
🇫🇷FR2.8%
🇪🇸ES2.3%
🇨🇭CH2%
🇳🇴NO1.9%
🇨🇦CAWebsites using OAI-SearchBot Disallow by industrymarket share · top 6 industries
News & Weather
Print & Publishing
Education
Technology & Computing
Shopping
Movies & TV
0%13%25%38%50%
Download report
We track 9,156 websites using OAI-SearchBot Disallow, along with their country, traffic, industry and platforms. There are 3,361 websites using OAI-SearchBot Disallow in United States.
Filter by country
🇺🇸 United States3,361 sites
🇬🇧 United Kingdom747 sites
🇩🇪 Germany510 sites
🇫🇷 France269 sites
🇪🇸 Spain260 sites
🇨🇭 Switzerland208 sites
🇳🇴 Norway181 sites
🇨🇦 Canada175 sites
🇳🇱 Netherlands174 sites
🇮🇹 Italy139 sites
🇸🇪 Sweden136 sites
🇦🇺 Australia124 sites
🇧🇪 Belgium107 sites
🇩🇰 Denmark87 sites
🇫🇮 Finland87 sites
🇯🇵 Japan86 sites
🇧🇷 Brazil84 sites
🇵🇱 Poland77 sites
🇮🇳 India68 sites
🇨🇳 China35 sites
🇨🇿 Czechia33 sites
🇦🇹 Austria27 sites
🇰🇷 Korea, Republic of26 sites
🇷🇺 Russian Federation26 sites
🇦🇷 Argentina24 sites
🇹🇷 Turkey23 sites
🇮🇪 Ireland22 sites
🇭🇺 Hungary19 sites
🇮🇩 Indonesia19 sites
🇿🇦 South Africa19 sites
🇨🇱 Chile18 sites
🇵🇹 Portugal18 sites
🇳🇿 New Zealand17 sites
🇬🇷 Greece16 sites
🇲🇽 Mexico12 sites
🇭🇰 Hong Kong9 sites
🇱🇹 Lithuania9 sites
🇸🇬 Singapore9 sites
🇷🇴 Romania9 sites
🇪🇬 Egypt8 sites
🇱🇺 Luxembourg8 sites
🇸🇰 Slovakia8 sites
🇨🇴 Colombia8 sites
🇱🇻 Latvia7 sites
🇵🇪 Peru7 sites
🇹🇼 Taiwan, Province of China7 sites
🇻🇪 Venezuela, Bolivarian Republic of7 sites
🇪🇪 Estonia6 sites
🇮🇱 Israel6 sites
🇸🇦 Saudi Arabia6 sites
🇻🇳 Viet Nam6 sites
🇵🇷 Puerto Rico6 sites
🇧🇬 Bulgaria5 sites
🇵🇭 Philippines5 sites
🇸🇮 Slovenia5 sites
🇲🇦 Morocco5 sites
🇮🇷 Iran, Islamic Republic of5 sites
🇧🇸 Bahamas4 sites
🇭🇷 Croatia4 sites
🇰🇿 Kazakhstan4 sites
🇺🇦 Ukraine4 sites
🇲🇾 Malaysia4 sites
🇷🇸 Serbia3 sites
🇧🇩 Bangladesh3 sites
🇲🇹 Malta3 sites
🇵🇰 Pakistan3 sites
🇳🇬 Nigeria3 sites
🇶🇦 Qatar3 sites
🇬🇭 Ghana3 sites
🇦🇪 United Arab Emirates2 sites
🇹🇭 Thailand2 sites
🇺🇬 Uganda2 sites
🇺🇾 Uruguay2 sites
🇳🇦 Namibia2 sites
🇸🇻 El Salvador2 sites
🇨🇮 Côte d'Ivoire2 sites
🇨🇾 Cyprus2 sites
🇸🇱 Sierra Leone2 sites
🇱🇮 Liechtenstein2 sites
🇨🇷 Costa Rica2 sites
🇹🇹 Trinidad and Tobago2 sites
🇪🇨 Ecuador1 sites
🇬🇦 Gabon1 sites
🇯🇴 Jordan1 sites
🇱🇰 Sri Lanka1 sites
🇽🇰 Kosovo1 sites
🇬🇱 Greenland1 sites
🇭🇹 Haiti1 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇲🇩 Moldova, Republic of1 sites
🇨🇼 Curaçao1 sites
🇮🇸 Iceland1 sites
🇫🇯 Fiji1 sites
🇵🇾 Paraguay1 sites
🇻🇨 Saint Vincent and the Grenadines1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇨🇽 Christmas Island1 sites
🇧🇾 Belarus1 sites
🇷🇪 Réunion1 sites
🇬🇲 Gambia1 sites
🇱🇧 Lebanon1 sites
🇬🇺 Guam1 sites
🇰🇪 Kenya1 sites
🇰🇬 Kyrgyzstan1 sites
🇲🇵 Northern Mariana Islands1 sites
🇹🇬 Togo1 sites
🇹🇳 Tunisia1 sites
🇻🇮 Virgin Islands, U.S.1 sites
🇬🇹 Guatemala1 sites
🇲🇰 North Macedonia1 sites
🇷🇼 Rwanda1 sites
About OAI-SearchBot Disallow
Sites blocking the OAI-SearchBot crawler in robots.txt.
Categories
Websites using OAI-SearchBot Disallow
showing 25 of 9,156| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇩🇪DE | Top 500 | Entertainment | |
| 🇨🇳CN | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇬🇧GB | Top 500 | Mental Health | |
 amazon.ca | 🇨🇦CA | Top 1K | Logistics & Shipping |
 amazon.in | 🇮🇳IN | Top 1K | Shopping |
| 🇺🇸US | Top 1K | Design & Creative | |
| 🇺🇸US | Top 1K | Print & Publishing | |
| 🇺🇸US | Top 1K | Technology & Computing | |
| 🇫🇷FR | Top 1K | News & Weather | |
| 🇦🇺AU | Top 1K | Entertainment | |
| 🇺🇸US | Top 1K | Entertainment | |
| 🇬🇧GB | Top 1K | News & Weather | |
| - | Top 5K | Fine Art | |
| 🇺🇸US | Top 5K | Technology & Computing | |
| 🇫🇷FR | Top 5K | Movies & TV | |
| 🇩🇪DE | Top 5K | News & Weather | |
| 🇪🇸ES | Top 5K | News & Weather | |
| - | Top 5K | Technology & Computing | |
| 🇺🇸US | Top 5K | Technology & Computing |
Showing 25 of 9,156 websitesView detailed list →
