aboutsummaryrefslogtreecommitdiff
path: root/www/p5-WWW-RobotRules/distinfo
Commit message (Collapse)AuthorAgeFilesLines
* - Update to 6.02Sunpoet Po-Chuan Hsieh2012-02-191-2/+2
| | | | | | | Changes: http://search.cpan.org/dist/WWW-RobotRules/Changes Notes: svn path=/head/; revision=291809
* WWW::RobotRules parses /robots.txt files which are used to forbid conformingFrederic Culot2011-04-141-0/+2
robots from accessing parts of a web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. WWW: http://search.cpan.org/dist/WWW-RobotRules/ This new port is needed to update www/p5-libwww. Notes: svn path=/head/; revision=272722