Browse Source

* ban noisy bot

master
Alex 'AdUser' Z 7 years ago
parent
commit
c75c8e0cc2
  1. 3
      theme/site/robots.txt.ep

3
theme/site/robots.txt.ep

@ -11,5 +11,8 @@ Disallow: *
User-Agent: MJ12bot User-Agent: MJ12bot
Disallow: * Disallow: *
User-Agent: SemrushBot
Disallow: *
User-agent: WebIndex User-agent: WebIndex
Disallow: * Disallow: *

Loading…
Cancel
Save