.\" -*- mode: troff; coding: utf-8 -*- .\" Automatically generated by Pod::Man v6.0.2 (Pod::Simple 3.45) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" \*(C` and \*(C' are quotes in nroff, nothing in troff, for use with C<>. .ie n \{\ . ds C` "" . ds C' "" 'br\} .el\{\ . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is >0, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{\ . if \nF \{\ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{\ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" .\" Required to disable full justification in groff 1.23.0. .if n .ds AD l .\" ======================================================================== .\" .IX Title "WWW::RobotRules::DB_File 3" .TH WWW::RobotRules::DB_File 3 2026-05-23 "perl v5.42.2" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH NAME WWW::RobotRules::DB_File \- Parse robots.txt files using a disk cache .SH SYNOPSIS .IX Header "SYNOPSIS" .Vb 2 \& require WWW::RobotRules::DB_File; \& require LWP::RobotUA; \& \& #Create a robot useragent that uses a disk caching RobotRules \& $ua = WWW::RobotUA\->new( \*(Aqmy\-robot/1.0\*(Aq, \*(Aqme@foo.com\*(Aq , \& WWW::RobotRules::DB_File\->new( \*(Aqmy\-robot/1.0\*(Aq, \*(Aq/path/cachefile\*(Aq )); \& \& #The just use $ua as usual \& $res=$ua\->request($req); .Ve .SH DESCRIPTION .IX Header "DESCRIPTION" This is a subclass of WWW::RobotRules that uses the DB_File package to implement disk caching of robots.txt. .SH METHODS .IX Header "METHODS" This is a subclass of WWW::RobotRules, so it implements the same methods .ie n .IP "$rules = WWW::RobotRules::DB_File\->new(\*(Aqmy\-robot/1.0\*(Aq, /path/cachefile)" 4 .el .IP "\f(CW$rules\fR = WWW::RobotRules::DB_File\->new(\*(Aqmy\-robot/1.0\*(Aq, /path/cachefile)" 4 .IX Item "$rules = WWW::RobotRules::DB_File->new('my-robot/1.0', /path/cachefile)" This is the constructor. The only difference from the original constructor from WWW::RobotRules is that you here has to specify a cache file as well. .SH "SEE ALSO" .IX Header "SEE ALSO" WWW::RobotRules .SH AUTHOR .IX Header "AUTHOR" Hakan Ardo