Magpie-Crawler Disallow tracking and usage
Websites using Magpie-Crawler Disallow by countrymarket share
34%
🇺🇸US8.7%
🇩🇪DE7.3%
🇬🇧GB3.5%
🇪🇸ES3.1%
🇳🇱NL2.3%
🇦🇺AU2.1%
🇫🇷FR2.1%
🇮🇹ITWebsites using Magpie-Crawler Disallow by industrymarket share · top 6 industries
News & Weather
Shopping
Sports
Technology & Computing
Travel
SaaS & Cloud
0%10%20%30%40%
Download report
We track 9,206 websites using Magpie-Crawler Disallow, along with their country, traffic, industry and platforms. There are 3,143 websites using Magpie-Crawler Disallow in United States.
Filter by country
🇺🇸 United States3,143 sites
🇩🇪 Germany802 sites
🇬🇧 United Kingdom669 sites
🇪🇸 Spain318 sites
🇳🇱 Netherlands289 sites
🇦🇺 Australia215 sites
🇫🇷 France196 sites
🇮🇹 Italy191 sites
🇨🇦 Canada184 sites
🇵🇱 Poland163 sites
🇨🇭 Switzerland99 sites
🇧🇷 Brazil81 sites
🇸🇪 Sweden72 sites
🇮🇳 India71 sites
🇷🇺 Russian Federation60 sites
🇦🇹 Austria41 sites
🇩🇰 Denmark40 sites
🇯🇵 Japan39 sites
🇧🇪 Belgium38 sites
🇬🇷 Greece35 sites
🇵🇹 Portugal31 sites
🇸🇦 Saudi Arabia27 sites
🇮🇩 Indonesia26 sites
🇷🇼 Rwanda23 sites
🇹🇷 Turkey21 sites
🇸🇬 Singapore20 sites
🇻🇳 Viet Nam20 sites
🇨🇳 China18 sites
🇫🇮 Finland18 sites
🇨🇿 Czechia17 sites
🇭🇺 Hungary17 sites
🇦🇷 Argentina16 sites
🇳🇿 New Zealand16 sites
🇲🇽 Mexico13 sites
🇳🇴 Norway13 sites
🇷🇴 Romania13 sites
🇦🇪 United Arab Emirates12 sites
🇨🇴 Colombia12 sites
🇺🇦 Ukraine12 sites
🇮🇪 Ireland11 sites
🇱🇹 Lithuania11 sites
🇧🇬 Bulgaria9 sites
🇹🇼 Taiwan, Province of China9 sites
🇵🇷 Puerto Rico8 sites
🇿🇦 South Africa8 sites
🇲🇦 Morocco8 sites
🇮🇷 Iran, Islamic Republic of7 sites
🇵🇰 Pakistan7 sites
🇹🇭 Thailand7 sites
🇻🇪 Venezuela, Bolivarian Republic of7 sites
🇵🇭 Philippines7 sites
🇪🇪 Estonia6 sites
🇰🇪 Kenya6 sites
🇵🇪 Peru6 sites
🇸🇰 Slovakia6 sites
🇧🇩 Bangladesh6 sites
🇭🇰 Hong Kong6 sites
🇨🇱 Chile5 sites
🇱🇺 Luxembourg5 sites
🇩🇴 Dominican Republic5 sites
🇲🇨 Monaco5 sites
🇰🇷 Korea, Republic of5 sites
🇱🇻 Latvia5 sites
🇲🇾 Malaysia4 sites
🇪🇬 Egypt4 sites
🇭🇷 Croatia3 sites
🇲🇹 Malta3 sites
🇳🇦 Namibia3 sites
🇵🇦 Panama3 sites
🇴🇲 Oman3 sites
🇬🇭 Ghana3 sites
🇨🇾 Cyprus3 sites
🇻🇨 Saint Vincent and the Grenadines3 sites
🇪🇨 Ecuador2 sites
🇸🇮 Slovenia2 sites
🇦🇲 Armenia2 sites
🇻🇮 Virgin Islands, U.S.2 sites
🇨🇮 Côte d'Ivoire2 sites
🇹🇳 Tunisia2 sites
🇲🇩 Moldova, Republic of2 sites
🇺🇾 Uruguay2 sites
🇦🇩 Andorra1 sites
🇧🇦 Bosnia and Herzegovina1 sites
🇭🇹 Haiti1 sites
🇰🇭 Cambodia1 sites
🇲🇶 Martinique1 sites
🇧🇳 Brunei Darussalam1 sites
🇨🇷 Costa Rica1 sites
🇬🇱 Greenland1 sites
🇭🇳 Honduras1 sites
🇯🇴 Jordan1 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇬🇬 Guernsey1 sites
🇧🇭 Bahrain1 sites
🇸🇴 Somalia1 sites
🇯🇪 Jersey1 sites
🇸🇳 Senegal1 sites
🇦🇿 Azerbaijan1 sites
🇰🇼 Kuwait1 sites
🇷🇸 Serbia1 sites
🇱🇾 Libya1 sites
🇧🇾 Belarus1 sites
🇦🇼 Aruba1 sites
🇧🇿 Belize1 sites
🇧🇲 Bermuda1 sites
🇨🇺 Cuba1 sites
🇬🇹 Guatemala1 sites
🇮🇱 Israel1 sites
🇳🇬 Nigeria1 sites
🇹🇬 Togo1 sites
🇱🇷 Liberia1 sites
🇱🇮 Liechtenstein1 sites
🇲🇰 North Macedonia1 sites
About Magpie-Crawler Disallow
This website has found the Disallow rules for Magpie-Crawler.
Categories
Official website
www.brandwatch.com/magpie-crawler↗
Websites using Magpie-Crawler Disallow
showing 25 of 9,206| Website | Country | Traffic | Industry |
|---|---|---|---|
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇬🇧GB | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇺🇸US | Top 500 | News & Weather | |
| 🇫🇷FR | Top 500 | Marketing & Advertising | |
| 🇺🇸US | Top 500 | Movies & TV | |
| 🇩🇪DE | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Print & Publishing | |
| 🇮🇹IT | Top 1K | News & Weather | |
| 🇪🇸ES | Top 1K | News & Weather | |
| 🇺🇸US | Top 1K | Software Development | |
| 🇺🇸US | Top 1K | Entertainment | |
| 🇵🇱PL | Top 5K | Marketing & Advertising | |
| 🇺🇸US | Top 5K | Technology & Computing | |
| 🇫🇷FR | Top 5K | Movies & TV | |
| 🇨🇭CH | Top 5K | News & Weather | |
| 🇺🇸US | Top 5K | News & Weather | |
| 🇪🇸ES | Top 5K | News & Weather | |
| 🇩🇪DE | Top 5K | Legal Services | |
| 🇩🇪DE | Top 5K | Technology & Computing | |
| 🇷🇺RU | Top 5K | Law & Government | |
| 🇺🇸US | Top 5K | Print & Publishing | |
| 🇺🇸US | Top 5K | Business & Finance | |
| 🇮🇩ID | Top 5K | News & Weather | |
| 🇪🇸ES | Top 5K | News & Weather |
Showing 25 of 9,206 websitesView detailed list →
