FriendlyCrawler Disallow tracking and usage
Websites using FriendlyCrawler Disallow by countrymarket share
29%
🇺🇸US13%
🇬🇧GB12%
🇩🇪DE4.9%
🇫🇷FR2.2%
🇸🇪SE2%
🇮🇹IT2%
🇨🇦CA1.4%
🇦🇺AUWebsites using FriendlyCrawler Disallow by industrymarket share · top 6 industries
News & Weather
Automotive
Technology & Computing
Print & Publishing
Movies & TV
Shopping
0%10%20%30%40%
Download report
We track 1,712 websites using FriendlyCrawler Disallow, along with their country, traffic, industry and platforms. There are 489 websites using FriendlyCrawler Disallow in United States.
Filter by country
🇺🇸 United States489 sites
🇬🇧 United Kingdom215 sites
🇩🇪 Germany198 sites
🇫🇷 France84 sites
🇸🇪 Sweden37 sites
🇮🇹 Italy34 sites
🇨🇦 Canada34 sites
🇦🇺 Australia24 sites
🇪🇸 Spain23 sites
🇦🇹 Austria22 sites
🇫🇮 Finland21 sites
🇵🇱 Poland19 sites
🇳🇱 Netherlands18 sites
🇨🇭 Switzerland18 sites
🇧🇷 Brazil14 sites
🇧🇪 Belgium14 sites
🇦🇷 Argentina11 sites
🇿🇦 South Africa11 sites
🇮🇳 India11 sites
🇳🇴 Norway11 sites
🇨🇿 Czechia9 sites
🇮🇩 Indonesia7 sites
🇰🇷 Korea, Republic of7 sites
🇯🇵 Japan6 sites
🇨🇱 Chile6 sites
🇲🇽 Mexico5 sites
🇵🇹 Portugal5 sites
🇨🇳 China5 sites
🇻🇪 Venezuela, Bolivarian Republic of4 sites
🇷🇺 Russian Federation4 sites
🇩🇰 Denmark4 sites
🇻🇳 Viet Nam4 sites
🇹🇼 Taiwan, Province of China3 sites
🇮🇪 Ireland3 sites
🇸🇮 Slovenia3 sites
🇵🇭 Philippines3 sites
🇭🇺 Hungary3 sites
🇷🇴 Romania3 sites
🇲🇦 Morocco3 sites
🇸🇦 Saudi Arabia3 sites
🇪🇬 Egypt2 sites
🇶🇦 Qatar2 sites
🇲🇾 Malaysia2 sites
🇸🇬 Singapore2 sites
🇦🇪 United Arab Emirates2 sites
🇱🇹 Lithuania2 sites
🇮🇱 Israel1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇧🇩 Bangladesh1 sites
🇺🇿 Uzbekistan1 sites
🇱🇾 Libya1 sites
🇮🇷 Iran, Islamic Republic of1 sites
🇬🇷 Greece1 sites
🇪🇪 Estonia1 sites
🇵🇷 Puerto Rico1 sites
🇷🇪 Réunion1 sites
🇺🇦 Ukraine1 sites
🇨🇷 Costa Rica1 sites
🇷🇸 Serbia1 sites
🇨🇾 Cyprus1 sites
🇨🇲 Cameroon1 sites
🇹🇷 Turkey1 sites
🇦🇩 Andorra1 sites
🇨🇮 Côte d'Ivoire1 sites
🇸🇰 Slovakia1 sites
🇳🇬 Nigeria1 sites
🇫🇯 Fiji1 sites
🇹🇭 Thailand1 sites
🇺🇾 Uruguay1 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇪🇨 Ecuador1 sites
🇮🇲 Isle of Man1 sites
🇵🇪 Peru1 sites
🇳🇿 New Zealand1 sites
🇱🇻 Latvia1 sites
About FriendlyCrawler Disallow
Sites blocking the FriendlyCrawler crawler in robots.txt.
Categories
Websites using FriendlyCrawler Disallow
showing 25 of 1,712| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇺🇸US | Top 500 | Entertainment | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇬🇧GB | Top 500 | Print & Publishing | |
| 🇩🇪DE | Top 1K | News & Weather | |
 amazon.ca | 🇨🇦CA | Top 1K | Logistics & Shipping |
| 🇺🇸US | Top 1K | News & Weather | |
 amazon.in | 🇮🇳IN | Top 1K | Shopping |
| 🇺🇸US | Top 1K | Print & Publishing | |
| 🇮🇹IT | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Gaming | |
| - | Top 1K | Non-profit & Charity | |
| 🇺🇸US | Top 1K | Software Development | |
| 🇦🇺AU | Top 1K | Entertainment | |
| 🇬🇧GB | Top 1K | News & Weather | |
| - | Top 5K | Fine Art | |
| 🇳🇴NO | Top 5K | News & Weather | |
| 🇺🇸US | Top 5K | News & Weather | |
| 🇺🇸US | Top 5K | News & Weather | |
| 🇩🇪DE | Top 5K | Technology & Computing | |
| 🇺🇸US | Top 5K | Software Development | |
| 🇺🇸US | Top 5K | Print & Publishing | |
| 🇬🇧GB | Top 5K | Entertainment |
Showing 25 of 1,712 websitesView detailed list →
