Mercurial > rsstweet

view public/robots.txt @ 175:52252ae4b580

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Static tag because it's supposed to be the same across rsstweet installs
author nanaya <me@nanaya.pro>
date Tue, 02 Oct 2018 23:58:36 +0900
parents 1a281427e841
children 89f6c0016bab
line wrap: on
line source

# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
User-agent: *
Disallow: /