Scrapy Disallow tracking and usage
Websites using Scrapy Disallow by countrymarket share
26%
🇺🇸US9.2%
🇬🇧GB8.3%
🇩🇪DE8.2%
🇵🇱PL4%
🇫🇷FR3.2%
🇧🇷BR2.8%
🇮🇹IT2.3%
🇪🇸ESWebsites using Scrapy Disallow by industrymarket share · top 6 industries
News & Weather
Shopping
Real Estate
Technology & Computing
Education
Print & Publishing
0%6.3%13%19%25%
Download report
We track 3,485 websites using Scrapy Disallow, along with their country, traffic, industry and platforms. There are 902 websites using Scrapy Disallow in United States.
Filter by country
🇺🇸 United States902 sites
🇬🇧 United Kingdom322 sites
🇩🇪 Germany288 sites
🇵🇱 Poland286 sites
🇫🇷 France139 sites
🇧🇷 Brazil110 sites
🇮🇹 Italy98 sites
🇪🇸 Spain79 sites
🇨🇦 Canada68 sites
🇦🇺 Australia60 sites
🇳🇿 New Zealand58 sites
🇮🇳 India57 sites
🇷🇺 Russian Federation57 sites
🇳🇱 Netherlands53 sites
🇸🇪 Sweden48 sites
🇨🇭 Switzerland41 sites
🇦🇹 Austria39 sites
🇧🇪 Belgium34 sites
🇯🇵 Japan26 sites
🇫🇮 Finland24 sites
🇸🇦 Saudi Arabia22 sites
🇨🇿 Czechia18 sites
🇳🇴 Norway17 sites
🇨🇳 China12 sites
🇰🇷 Korea, Republic of12 sites
🇿🇦 South Africa12 sites
🇬🇷 Greece11 sites
🇮🇩 Indonesia10 sites
🇵🇹 Portugal9 sites
🇩🇰 Denmark9 sites
🇷🇴 Romania8 sites
🇦🇪 United Arab Emirates8 sites
🇹🇷 Turkey8 sites
🇦🇷 Argentina8 sites
🇲🇽 Mexico7 sites
🇵🇪 Peru7 sites
🇻🇪 Venezuela, Bolivarian Republic of6 sites
🇸🇬 Singapore6 sites
🇻🇳 Viet Nam6 sites
🇵🇭 Philippines5 sites
🇮🇪 Ireland5 sites
🇨🇱 Chile5 sites
🇧🇬 Bulgaria5 sites
🇹🇼 Taiwan, Province of China5 sites
🇲🇾 Malaysia4 sites
🇭🇺 Hungary4 sites
🇹🇭 Thailand4 sites
🇺🇦 Ukraine4 sites
🇸🇰 Slovakia4 sites
🇳🇬 Nigeria4 sites
🇱🇹 Lithuania4 sites
🇸🇮 Slovenia3 sites
🇵🇰 Pakistan3 sites
🇧🇾 Belarus3 sites
🇷🇸 Serbia3 sites
🇲🇨 Monaco3 sites
🇮🇷 Iran, Islamic Republic of3 sites
🇪🇨 Ecuador3 sites
🇺🇿 Uzbekistan2 sites
🇮🇱 Israel2 sites
🇧🇩 Bangladesh2 sites
🇨🇴 Colombia2 sites
🇶🇦 Qatar2 sites
🇺🇾 Uruguay2 sites
🇪🇬 Egypt2 sites
🇰🇿 Kazakhstan2 sites
🇲🇦 Morocco2 sites
🇨🇾 Cyprus2 sites
🇰🇭 Cambodia1 sites
🇹🇳 Tunisia1 sites
🇰🇼 Kuwait1 sites
🇭🇰 Hong Kong1 sites
🇮🇴 British Indian Ocean Territory1 sites
🇱🇾 Libya1 sites
🇧🇲 Bermuda1 sites
🇮🇸 Iceland1 sites
🇷🇪 Réunion1 sites
🇨🇷 Costa Rica1 sites
🇲🇩 Moldova, Republic of1 sites
🇪🇪 Estonia1 sites
🇭🇷 Croatia1 sites
🇦🇿 Azerbaijan1 sites
🇦🇩 Andorra1 sites
🇨🇲 Cameroon1 sites
🇧🇦 Bosnia and Herzegovina1 sites
🇨🇮 Côte d'Ivoire1 sites
🇸🇳 Senegal1 sites
🇵🇾 Paraguay1 sites
🇫🇯 Fiji1 sites
🇱🇺 Luxembourg1 sites
🇬🇭 Ghana1 sites
🇮🇲 Isle of Man1 sites
🇱🇻 Latvia1 sites
🇵🇷 Puerto Rico1 sites
About Scrapy Disallow
This website has found the Disallow rules for Scrapy.
Categories
Official website
scrapy.org↗
Websites using Scrapy Disallow
showing 25 of 3,485| Website | Country | Traffic | Industry |
|---|---|---|---|
 amazon.de | 🇩🇪DE | Top 500 | Logistics & Shipping |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇬🇧GB | Top 500 | Mental Health | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 1K | Technology & Computing | |
| 🇩🇪DE | Top 1K | News & Weather | |
 amazon.ca | 🇨🇦CA | Top 1K | Logistics & Shipping |
| 🇺🇸US | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Print & Publishing | |
 amazon.in | 🇮🇳IN | Top 1K | Shopping |
| 🇺🇸US | Top 1K | Print & Publishing | |
| 🇮🇹IT | Top 1K | News & Weather | |
| 🇫🇷FR | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Software Development | |
| 🇺🇸US | Top 1K | Software Development | |
| 🇦🇺AU | Top 1K | Entertainment | |
| 🇺🇸US | Top 1K | Entertainment | |
| 🇬🇧GB | Top 1K | News & Weather | |
| - | Top 5K | Fine Art | |
| 🇵🇱PL | Top 5K | Marketing & Advertising | |
| 🇳🇴NO | Top 5K | News & Weather |
Showing 25 of 3,485 websitesView detailed list →
