database of robots.txt-derived permissions
This module parses _/robots.txt_ files as specified in "A Standard for
Robot Exclusion", at Webmasters
can use the _/robots.txt_ file to forbid conforming robots from accessing
parts of their web site.
- Devel package for openSUSE:Factory
- Links to openSUSE:Factory / perl-WWW-RobotRules
- Download package
-
Checkout Package
osc -A https://api.opensuse.org checkout devel:languages:perl/perl-WWW-RobotRules && cd $_ - Create Badge
perl-WWW-RobotRules
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Package has built successfully and can be used to build further packages.
Comments 0