diff options
Diffstat (limited to 'www/py-robot-detection/pkg-descr')
| -rw-r--r-- | www/py-robot-detection/pkg-descr | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/www/py-robot-detection/pkg-descr b/www/py-robot-detection/pkg-descr new file mode 100644 index 000000000000..fd974991a39b --- /dev/null +++ b/www/py-robot-detection/pkg-descr @@ -0,0 +1,2 @@ +Library for detecting if a HTTP User Agent header is likely to be a bot. +It uses the list of registered robots from https://www.robotstxt.org/. |