cubicweb-sitemaps #723610 manage robot.txt file [open]

the widespread robot.txt format could be managed by this cube as well.

See http://www.robotstxt.org/robotstxt.html

prioritynormal
typeenhancement
done in<not specified>
closed by<not specified>