Mercurial > rsstweet

view public/robots.txt @ 211:e07f6ea17deb

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Less xhtml more escaping It looks like some older tweets aren't quite escaped properly for xhtml. Example (assuming not deleted): https://twitter.com/aaaa/status/169688458900668416
author nanaya <me@nanaya.pro>
date Fri, 11 Dec 2020 03:31:25 +0900
parents 1a281427e841
children 89f6c0016bab
line wrap: on
line source

# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
User-agent: *
Disallow: /