Mercurial > rsstweet
changeset 40:1a281427e841
Disallow site crawling.
| author | edogawaconan <me@myconan.net> | 
|---|---|
| date | Thu, 11 Dec 2014 15:56:16 +0900 | 
| parents | aa6d58c8653b | 
| children | d76324184cc7 | 
| files | public/robots.txt | 
| diffstat | 1 files changed, 2 insertions(+), 2 deletions(-) [+] | 
line wrap: on
 line diff
--- a/public/robots.txt Thu Dec 11 15:51:35 2014 +0900 +++ b/public/robots.txt Thu Dec 11 15:56:16 2014 +0900 @@ -1,5 +1,5 @@ # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: -# User-agent: * -# Disallow: / +User-agent: * +Disallow: /
