* ban noisy bot

7 years ago · c75c8e0cc2
1 changed files with 3 additions and 0 deletions
--- a/theme/site/robots.txt.ep
+++ b/theme/site/robots.txt.ep
@ -11,5 +11,8 @@ Disallow: *
 User-Agent: MJ12bot
 Disallow: *

+User-Agent: SemrushBot
+Disallow: *
+
 User-agent: WebIndex
 Disallow: *