Semrush Bot Disallow

Semrush Bot Disallow tracking and usage

Websites using Semrush Bot Disallow by countrymarket share
21%
🇺🇸US
5.8%
🇩🇪DE
5.7%
🇬🇧GB
3.9%
🇳🇱NL
3.6%
🇫🇷FR
2.9%
🇨🇦CA
2.9%
🇦🇺AU
2.5%
🇧🇷BR
Websites using Semrush Bot Disallow by industrymarket share · top 6 industries
Shopping
27%
Education
18%
Technology & Computing
18%
SaaS & Cloud
16%
Real Estate
10%
Law & Government
9.8%
0%7.5%15%23%30%
Download report

We track 128,876 websites using Semrush Bot Disallow, along with their country, traffic, industry and platforms. There are 27,020 websites using Semrush Bot Disallow in United States.

Filter by country
🇺🇸 United States27,020 sites
🇩🇪 Germany7,419 sites
🇬🇧 United Kingdom7,320 sites
🇳🇱 Netherlands4,968 sites
🇫🇷 France4,685 sites
🇨🇦 Canada3,791 sites
🇦🇺 Australia3,711 sites
🇧🇷 Brazil3,253 sites
🇪🇸 Spain3,251 sites
🇨🇳 China3,142 sites
🇮🇹 Italy3,115 sites
🇮🇳 India2,957 sites
🇵🇱 Poland2,549 sites
🇹🇷 Turkey1,967 sites
🇧🇪 Belgium1,563 sites
🇷🇺 Russian Federation1,528 sites
🇨🇭 Switzerland1,317 sites
🇯🇵 Japan1,151 sites
🇸🇪 Sweden1,047 sites
🇻🇳 Viet Nam948 sites
🇨🇿 Czechia939 sites
🇮🇩 Indonesia904 sites
🇦🇹 Austria661 sites
🇵🇹 Portugal642 sites
🇲🇽 Mexico636 sites
🇬🇷 Greece584 sites
🇦🇷 Argentina573 sites
🇫🇮 Finland567 sites
🇩🇰 Denmark554 sites
🇳🇿 New Zealand524 sites
🇿🇦 South Africa504 sites
🇳🇴 Norway490 sites
🇭🇺 Hungary478 sites
🇦🇪 United Arab Emirates466 sites
🇺🇦 Ukraine462 sites
🇷🇴 Romania417 sites
🇰🇷 Korea, Republic of399 sites
🇮🇪 Ireland369 sites
🇨🇱 Chile368 sites
🇨🇴 Colombia352 sites
🇸🇬 Singapore337 sites
🇵🇰 Pakistan295 sites
🇲🇾 Malaysia246 sites
🇹🇭 Thailand245 sites
🇮🇷 Iran, Islamic Republic of237 sites
🇸🇰 Slovakia231 sites
🇮🇱 Israel230 sites
🇧🇬 Bulgaria220 sites
🇭🇰 Hong Kong218 sites
🇸🇦 Saudi Arabia206 sites
🇪🇪 Estonia204 sites
🇵🇪 Peru191 sites
🇹🇼 Taiwan, Province of China191 sites
🇳🇬 Nigeria187 sites
🇪🇬 Egypt176 sites
🇧🇩 Bangladesh158 sites
🇱🇹 Lithuania149 sites
🇵🇭 Philippines146 sites
🇸🇮 Slovenia128 sites
🇱🇻 Latvia116 sites
🇰🇪 Kenya111 sites
🇭🇷 Croatia106 sites
🇷🇸 Serbia103 sites
🇱🇺 Luxembourg101 sites
🇲🇦 Morocco98 sites
🇱🇰 Sri Lanka86 sites
🇨🇾 Cyprus85 sites
🇷🇼 Rwanda80 sites
🇰🇿 Kazakhstan72 sites
🇮🇸 Iceland71 sites
🇩🇴 Dominican Republic69 sites
🇪🇨 Ecuador66 sites
🇺🇾 Uruguay65 sites
🇧🇾 Belarus62 sites
🇬🇭 Ghana62 sites
🇺🇿 Uzbekistan60 sites
🇲🇹 Malta51 sites
🇬🇪 Georgia48 sites
🇬🇹 Guatemala47 sites
🇵🇦 Panama47 sites
🇨🇷 Costa Rica43 sites
🇳🇵 Nepal43 sites
🇶🇦 Qatar43 sites
🇦🇿 Azerbaijan42 sites
🇲🇳 Mongolia41 sites
🇧🇦 Bosnia and Herzegovina40 sites
🇯🇴 Jordan40 sites
🇱🇧 Lebanon40 sites
🇻🇪 Venezuela, Bolivarian Republic of40 sites
🇰🇼 Kuwait37 sites
🇦🇱 Albania34 sites
🇵🇾 Paraguay33 sites
🇦🇲 Armenia32 sites
🇺🇬 Uganda32 sites
🇹🇳 Tunisia30 sites
🇴🇲 Oman30 sites
🇲🇩 Moldova, Republic of28 sites
🇨🇼 Curaçao28 sites
🇲🇺 Mauritius28 sites
🇮🇶 Iraq28 sites
🇵🇷 Puerto Rico23 sites
🇹🇿 Tanzania, United Republic of23 sites
🇻🇨 Saint Vincent and the Grenadines23 sites
🇨🇮 Côte d'Ivoire23 sites
🇸🇳 Senegal22 sites
🇲🇰 North Macedonia21 sites
🇩🇿 Algeria20 sites
🇽🇰 Kosovo20 sites
🇲🇨 Monaco20 sites
🇧🇭 Bahrain20 sites
🇰🇭 Cambodia19 sites
🇱🇮 Liechtenstein17 sites
🇧🇴 Bolivia, Plurinational State of17 sites
🇪🇹 Ethiopia17 sites
🇸🇴 Somalia16 sites
🇨🇲 Cameroon15 sites
🇵🇸 Palestine, State of15 sites
🇦🇴 Angola15 sites
🇦🇩 Andorra14 sites
🇯🇪 Jersey14 sites
🇧🇿 Belize14 sites
🇹🇹 Trinidad and Tobago13 sites
🇭🇳 Honduras12 sites
🇲🇬 Madagascar12 sites
🇲🇲 Myanmar11 sites
🇦🇽 Åland Islands11 sites
🇧🇲 Bermuda10 sites
🇲🇻 Maldives10 sites
🇿🇼 Zimbabwe10 sites
🇸🇻 El Salvador10 sites
🇯🇲 Jamaica9 sites
🇦🇬 Antigua and Barbuda9 sites
🇿🇲 Zambia8 sites
🇸🇨 Seychelles8 sites
🇷🇪 Réunion8 sites
🇦🇼 Aruba7 sites
🇦🇸 American Samoa7 sites
🇹🇯 Tajikistan7 sites
🇰🇬 Kyrgyzstan7 sites
🇬🇮 Gibraltar7 sites
🇸🇷 Suriname7 sites
🇻🇮 Virgin Islands, U.S.7 sites
🇮🇲 Isle of Man7 sites
🇧🇯 Benin7 sites
🇨🇩 Congo, The Democratic Republic of the7 sites
🇲🇪 Montenegro7 sites
🇸🇾 Syrian Arab Republic7 sites
🇨🇽 Christmas Island7 sites
🇰🇲 Comoros7 sites
🇳🇦 Namibia6 sites
🇵🇫 French Polynesia6 sites
🇰🇾 Cayman Islands6 sites
🇵🇼 Palau6 sites
🇲🇿 Mozambique6 sites
🇱🇾 Libya6 sites
🇨🇻 Cabo Verde6 sites
🇧🇳 Brunei Darussalam5 sites
🇬🇱 Greenland5 sites
🇬🇸 South Georgia and the South Sandwich Islands5 sites
🇳🇮 Nicaragua5 sites
🇧🇫 Burkina Faso5 sites
🇹🇬 Togo5 sites
🇦🇫 Afghanistan5 sites
🇸🇩 Sudan5 sites
🇬🇳 Guinea5 sites
🇲🇱 Mali4 sites
🇳🇨 New Caledonia4 sites
🇲🇸 Montserrat4 sites
🇬🇬 Guernsey4 sites
🇫🇯 Fiji4 sites
🇹🇨 Turks and Caicos Islands4 sites
🇲🇴 Macao4 sites
🇻🇬 Virgin Islands, British4 sites
🇧🇸 Bahamas3 sites
🇭🇹 Haiti3 sites
🇾🇹 Mayotte3 sites
🇧🇶 Bonaire, Sint Eustatius and Saba3 sites
🇸🇲 San Marino3 sites
🇨🇬 Congo3 sites
🇧🇧 Barbados3 sites
🇬🇲 Gambia3 sites
🇾🇪 Yemen3 sites
🇬🇩 Grenada3 sites
🇧🇼 Botswana3 sites
🇨🇺 Cuba3 sites
🇵🇲 Saint Pierre and Miquelon3 sites
🇹🇫 French Southern Territories3 sites
🇲🇶 Martinique2 sites
🇲🇼 Malawi2 sites
🇹🇲 Turkmenistan2 sites
🇬🇾 Guyana2 sites
🇬🇵 Guadeloupe2 sites
🇦🇮 Anguilla2 sites
🇩🇲 Dominica2 sites
🇬🇺 Guam2 sites
🇧🇮 Burundi2 sites
🇰🇳 Saint Kitts and Nevis2 sites
🇸🇹 Sao Tome and Principe2 sites
🇮🇴 British Indian Ocean Territory2 sites
🇳🇺 Niue2 sites
🇸🇸 South Sudan2 sites
🇼🇸 Samoa2 sites
🇳🇷 Nauru2 sites
🇬🇦 Gabon2 sites
🇸🇽 Sint Maarten (Dutch part)2 sites
🇹🇩 Chad2 sites
🇸🇯 Svalbard and Jan Mayen1 sites
🇸🇱 Sierra Leone1 sites
🇧🇱 Saint Barthélemy1 sites
🇸🇿 Eswatini1 sites
🇲🇭 Marshall Islands1 sites
🇨🇰 Cook Islands1 sites
🇳🇪 Niger1 sites
🇱🇦 Lao People's Democratic Republic1 sites
🇨🇫 Central African Republic1 sites
🇫🇴 Faroe Islands1 sites
🇱🇨 Saint Lucia1 sites
🇧🇹 Bhutan1 sites
🇸🇧 Solomon Islands1 sites
🇩🇯 Djibouti1 sites
🇹🇱 Timor-Leste1 sites
🇼🇫 Wallis and Futuna1 sites
🇻🇦 Holy See (Vatican City State)1 sites

About Semrush Bot Disallow

This website has found the Disallow rules for Semrush Bot.

Categories
Robots.txtWeb Standards
Official websitewww.semrush.com/bot↗

Websites using Semrush Bot Disallow

showing 25 of 128,876
WebsiteCountryTrafficIndustry
amazon.co.jp🇯🇵JPTop 500Shopping
spiegel.de🇩🇪DETop 500Print & Publishing
bandcamp.com🇺🇸USTop 500Music
lemonde.fr🇫🇷FRTop 500News & Weather
amazon.co.uk🇬🇧GBTop 500Entertainment
amazon.fr🇫🇷FRTop 500Logistics & Shipping
amazon.de🇩🇪DETop 500Logistics & Shipping
cnn.com🇺🇸USTop 500News & Weather
drom.ru🇷🇺RUTop 500Technology & Computing
launchpad.net🇬🇧GBTop 500Mental Health
issuu.com🇺🇸USTop 500Software Development
lesechos.fr🇫🇷FRTop 1KNews & Weather
nejm.org🇺🇸USTop 1KPrint & Publishing
amazon.it🇮🇹ITTop 1KShopping
welt.de🇩🇪DETop 1KNews & Weather
unep.org🇰🇪KETop 1KLaw & Government
amazon.es🇪🇸ESTop 1KTechnology & Computing
amazon.com.au🇦🇺AUTop 1KShopping
bild.de🇩🇪DETop 1KNews & Weather
amazon.ca🇨🇦CATop 1KLogistics & Shipping
theverge.com🇺🇸USTop 1KNews & Weather
amazon.in🇮🇳INTop 1KShopping
repubblica.it🇮🇹ITTop 1KNews & Weather
eset.com🇺🇸USTop 1KSoftware Development
telegraph.co.uk🇬🇧GBTop 1KNews & Weather
Showing 25 of 128,876 websitesView detailed list →

Alternatives

same category
HTML5 DocType45.32MsitesFacebook Redirect17.91MsitesInstagram11.7MsitesOrganization Schema7.24MsitesLinkedIn6.25MsitesUTF-86.01MsitesEvents Page4.51MsitesAPI or Developer Page3.76Msites