You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

19 lines
250 B

9 years ago
Host: linuxdv.org
Sitemap: <%= $site->url('sitemap.xml') %>
User-Agent: *
Disallow: /zerobin2/
Disallow: /git/
9 years ago
User-Agent: AhrefsBot
Disallow: *
User-Agent: MJ12bot
Disallow: *
7 years ago
User-Agent: SemrushBot
Disallow: *
User-agent: WebIndex
Disallow: *