Mercurial > rsstweet

view public/robots.txt @ 148:c57e51af4692

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Update with latest rails Not sure why "rails" is specifically required now.
author nanaya <me@nanaya.pro>
date Sat, 13 Jan 2018 03:16:17 +0900
parents 1a281427e841
children 89f6c0016bab
line wrap: on
line source

# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
User-agent: *
Disallow: /