Scrapy Disallow tracking and usage
Websites using Scrapy Disallow by countrymarket share
25%
🇺🇸US9%
🇩🇪DE6%
🇦🇺AU5.1%
🇬🇧GB4.9%
🇵🇱PL3.4%
🇫🇷FR2.9%
🇳🇱NL2.7%
🇮🇹ITWebsites using Scrapy Disallow by industrymarket share · top 6 industries
News & Weather
Shopping
Technology & Computing
Real Estate
SaaS & Cloud
Print & Publishing
0%10%20%30%40%
Download report
We track 18,013 websites using Scrapy Disallow, along with their country, traffic, industry and platforms. There are 4,489 websites using Scrapy Disallow in United States.
Filter by country
🇺🇸 United States4,489 sites
🇩🇪 Germany1,629 sites
🇦🇺 Australia1,087 sites
🇬🇧 United Kingdom927 sites
🇵🇱 Poland888 sites
🇫🇷 France606 sites
🇳🇱 Netherlands530 sites
🇮🇹 Italy484 sites
🇪🇸 Spain457 sites
🇨🇦 Canada391 sites
🇧🇷 Brazil351 sites
🇷🇺 Russian Federation300 sites
🇨🇭 Switzerland233 sites
🇳🇴 Norway206 sites
🇸🇪 Sweden196 sites
🇮🇳 India182 sites
🇧🇪 Belgium138 sites
🇦🇹 Austria121 sites
🇳🇿 New Zealand113 sites
🇯🇵 Japan101 sites
🇨🇿 Czechia91 sites
🇸🇦 Saudi Arabia89 sites
🇫🇮 Finland72 sites
🇷🇼 Rwanda67 sites
🇦🇷 Argentina63 sites
🇺🇦 Ukraine63 sites
🇩🇰 Denmark52 sites
🇨🇳 China51 sites
🇬🇷 Greece51 sites
🇵🇹 Portugal51 sites
🇹🇷 Turkey51 sites
🇰🇷 Korea, Republic of44 sites
🇿🇦 South Africa42 sites
🇮🇩 Indonesia39 sites
🇲🇽 Mexico35 sites
🇭🇺 Hungary34 sites
🇷🇴 Romania32 sites
🇮🇷 Iran, Islamic Republic of28 sites
🇦🇪 United Arab Emirates27 sites
🇮🇸 Iceland27 sites
🇻🇳 Viet Nam25 sites
🇮🇪 Ireland23 sites
🇸🇬 Singapore23 sites
🇹🇭 Thailand23 sites
🇧🇬 Bulgaria18 sites
🇨🇱 Chile18 sites
🇸🇰 Slovakia18 sites
🇵🇪 Peru17 sites
🇵🇭 Philippines16 sites
🇧🇾 Belarus16 sites
🇸🇮 Slovenia15 sites
🇨🇴 Colombia15 sites
🇲🇾 Malaysia15 sites
🇻🇪 Venezuela, Bolivarian Republic of15 sites
🇹🇼 Taiwan, Province of China14 sites
🇷🇸 Serbia13 sites
🇱🇹 Lithuania12 sites
🇲🇨 Monaco11 sites
🇮🇱 Israel11 sites
🇪🇪 Estonia10 sites
🇱🇺 Luxembourg10 sites
🇪🇬 Egypt9 sites
🇭🇰 Hong Kong9 sites
🇳🇬 Nigeria8 sites
🇧🇩 Bangladesh8 sites
🇧🇦 Bosnia and Herzegovina7 sites
🇲🇹 Malta7 sites
🇵🇰 Pakistan7 sites
🇨🇾 Cyprus7 sites
🇺🇾 Uruguay7 sites
🇰🇪 Kenya7 sites
🇱🇻 Latvia6 sites
🇵🇷 Puerto Rico6 sites
🇲🇦 Morocco6 sites
🇭🇷 Croatia6 sites
🇬🇪 Georgia6 sites
🇲🇰 North Macedonia5 sites
🇨🇷 Costa Rica5 sites
🇪🇨 Ecuador4 sites
🇰🇿 Kazakhstan4 sites
🇹🇳 Tunisia4 sites
🇺🇿 Uzbekistan4 sites
🇻🇨 Saint Vincent and the Grenadines4 sites
🇧🇸 Bahamas3 sites
🇮🇲 Isle of Man3 sites
🇦🇲 Armenia3 sites
🇬🇹 Guatemala3 sites
🇺🇬 Uganda2 sites
🇴🇲 Oman2 sites
🇶🇦 Qatar2 sites
🇫🇯 Fiji2 sites
🇵🇾 Paraguay2 sites
🇭🇳 Honduras2 sites
🇧🇴 Bolivia, Plurinational State of2 sites
🇨🇲 Cameroon2 sites
🇦🇩 Andorra2 sites
🇷🇪 Réunion2 sites
🇲🇩 Moldova, Republic of2 sites
🇦🇱 Albania2 sites
🇩🇴 Dominican Republic2 sites
🇹🇹 Trinidad and Tobago2 sites
🇦🇸 American Samoa2 sites
🇱🇮 Liechtenstein2 sites
🇳🇵 Nepal2 sites
🇨🇼 Curaçao2 sites
🇽🇰 Kosovo1 sites
🇾🇹 Mayotte1 sites
🇲🇺 Mauritius1 sites
🇬🇭 Ghana1 sites
🇯🇴 Jordan1 sites
🇨🇺 Cuba1 sites
🇸🇳 Senegal1 sites
🇲🇪 Montenegro1 sites
🇦🇬 Antigua and Barbuda1 sites
🇨🇮 Côte d'Ivoire1 sites
🇧🇼 Botswana1 sites
🇦🇿 Azerbaijan1 sites
🇰🇼 Kuwait1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇱🇾 Libya1 sites
🇧🇲 Bermuda1 sites
🇬🇺 Guam1 sites
🇰🇭 Cambodia1 sites
🇲🇵 Northern Mariana Islands1 sites
🇹🇬 Togo1 sites
🇻🇮 Virgin Islands, U.S.1 sites
🇻🇺 Vanuatu1 sites
🇧🇹 Bhutan1 sites
🇰🇬 Kyrgyzstan1 sites
🇱🇸 Lesotho1 sites
🇲🇳 Mongolia1 sites
🇵🇼 Palau1 sites
🇵🇫 French Polynesia1 sites
🇸🇧 Solomon Islands1 sites
🇸🇽 Sint Maarten (Dutch part)1 sites
🇼🇸 Samoa1 sites
🇦🇫 Afghanistan1 sites
🇧🇯 Benin1 sites
🇲🇬 Madagascar1 sites
🇲🇲 Myanmar1 sites
🇲🇿 Mozambique1 sites
🇳🇦 Namibia1 sites
🇦🇴 Angola1 sites
🇪🇹 Ethiopia1 sites
🇳🇮 Nicaragua1 sites
🇹🇿 Tanzania, United Republic of1 sites
About Scrapy Disallow
This website has found the Disallow rules for Scrapy.
Categories
Official website
scrapy.org↗
Websites using Scrapy Disallow
showing 25 of 18,013| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.co.jp | 🇯🇵JP | Top 500 | Shopping |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇩🇪DE | Top 500 | Print & Publishing | |
| 🇮🇳IN | Top 500 | Religion & Spirituality | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | Technology & Computing | |
 amazon.co.uk | 🇬🇧GB | Top 500 | Entertainment |
| 🇺🇸US | Top 500 | Print & Publishing | |
 amazon.fr | 🇫🇷FR | Top 500 | Logistics & Shipping |
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | Technology & Computing | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇬🇧GB | Top 500 | Mental Health | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇦🇺AU | Top 500 | Software Development | |
| 🇬🇧GB | Top 1K | Software Development | |
| 🇺🇸US | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Print & Publishing |
Showing 25 of 18,013 websitesView detailed list →
