blob: f729de222c85d20dbab62eea7cb8843fad5addf4 (
plain) (
blame)
1
2
3
4
5
|
HTML::RobotsMETA is a simple HTML::Parser subclass
that extracts robots exclusion information from meta tags.
Author: Daisuke Maki <dmaki@cpan.org>
WWW: http://search.cpan.org/~dmaki/HTML-RobotsMETA/
|