ports - FreeBSD ports tree

	Commit message (Collapse)	Author	Age	Files	Lines
*	WWW::RobotRules::Parser allows you to simply parse robots.txt files	Martin Wilke	2008-02-16	4	-0/+40
	as described in http://www.robotstxt.org/wc/norobots.html. WWW: http://http://search.cpan.org/dist/WWW-RobotRules-Parser/ PR: ports/120160 Submitted by: Masahiro Teramoto <markun at onohara.to> Notes: svn path=/head/; revision=207323