Mercurial > rsstweet
changeset 40:1a281427e841
Disallow site crawling.
author | edogawaconan <me@myconan.net> |
---|---|
date | Thu, 11 Dec 2014 15:56:16 +0900 |
parents | aa6d58c8653b |
children | d76324184cc7 |
files | public/robots.txt |
diffstat | 1 files changed, 2 insertions(+), 2 deletions(-) [+] |
line wrap: on
line diff
--- a/public/robots.txt Thu Dec 11 15:51:35 2014 +0900 +++ b/public/robots.txt Thu Dec 11 15:56:16 2014 +0900 @@ -1,5 +1,5 @@ # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: -# User-agent: * -# Disallow: / +User-agent: * +Disallow: /