Mercurial > rsstweet
diff public/robots.txt @ 254:89f6c0016bab default tip
Update to latest rails
author | nanaya <me@nanaya.net> |
---|---|
date | Tue, 03 Sep 2024 19:21:25 +0900 |
parents | 1a281427e841 |
children |
line wrap: on
line diff
--- a/public/robots.txt Mon Mar 25 02:49:50 2024 +0900 +++ b/public/robots.txt Tue Sep 03 19:21:25 2024 +0900 @@ -1,5 +1,3 @@ -# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file -# -# To ban all spiders from the entire site uncomment the next two lines: +# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Disallow: /