database of robots.txt-derived permissions
http://search.cpan.org/dist/WWW-RobotRules/
This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
- Links to SUSE:ALP:...ndard:0.1 / perl-WWW-RobotRules
- Download package
-
Checkout Package
osc -A https://api.opensuse.org checkout SUSE:ALP:Source:Standard:Core:0.1/perl-WWW-RobotRules && cd $_ - Create Badge
Refresh
Refresh
Source Files (show merged sources derived from linked package)
| Filename | Size | Changed |
|---|---|---|
| _link | 0000000474 474 Bytes |
Latest Revision
Jiri Srain (jsrain)
committed
(revision 1)
Comments 0