A simple library to obey robots.txt files

WWW:	http://rubygems.org/gems/robotex