diff options
Diffstat (limited to 'www/p5-WWW-RobotRules/pkg-descr')
| -rw-r--r-- | www/p5-WWW-RobotRules/pkg-descr | 2 |
1 files changed, 0 insertions, 2 deletions
diff --git a/www/p5-WWW-RobotRules/pkg-descr b/www/p5-WWW-RobotRules/pkg-descr index d633f72baa8c..221877f5dc8e 100644 --- a/www/p5-WWW-RobotRules/pkg-descr +++ b/www/p5-WWW-RobotRules/pkg-descr @@ -2,5 +2,3 @@ This module parses /robots.txt files which are used to forbid conforming robots from accessing parts of a web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. - -WWW: https://metacpan.org/release/WWW-RobotRules |