Service currently running (reload page).

database of robots.txt-derived permissions

Edit Package perl-WWW-RobotRules
http://search.cpan.org/dist/WWW-RobotRules/

This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.

Refresh
Refresh
Source Files
Filename Size Changed
Revision 5 (latest revision is 22)
Lubos Kocman's avatar Lubos Kocman (lkocman-factory) committed (revision 5)
branch from 15.1
Comments 0
openSUSE Build Service is sponsored by