## Competitive operation

Date | 30.08.2000
Name | Golovkine Alexandre
E-Mail | algol@hotmail.ru

PROJECT 2.1 : Web site grabber- extor.pl

- Script description
- Installation instructions (Apache configuration, perl or php modules configuration, ?)
- Commented scripts
- Commented work (problems, ideas, methods, known bugs, ?)

Script description

> The script is intended for copying Contents of site on the local disk. For want of install on the remote server can To create a mirror copy, of given, site. Is started from the command line with the indication URL. The amount of the required documents is installed in a body of the script .

Installation instructions

> Installation is possible on any platform, Supporting Perl. The program is developed in the Win environment, Was tested on Linux. For installation in the environment Windows is necessary a package Active Perl 5.6.06. Before installation it is necessary To install correct path to To the interpreter Perl in the first line scripts for example
> !# /usr/bin/perl Installation - copy the file on a hard disk and to execute the chmod command 0755. In a body of the program to install an amount of the copied documents and their accommodation

Commented scripts:

> On the indicated address URL the program Scans all pages on availability in them of the references On other pages and references to the images Placed in, Limits of the indicated address. In limits The given limit the files are copied in indicated the directory. In the map.txt file the result of scanning site on availability links on pages it of site and image is written. By default in /grabber/ contents сайта with allowance for structures and and possibility local transition under the references are written.

Commented work:

> For want of copying of interactive pages using some server- technologies, cgi for example, is copied page generated by the server and copy receives the appropriate (.cgi) extension, but to become the usual file with by hypertext. With the purposes of preservation Structures сайта such pages not Are renamed. And it in turn conducts to errors of review those using the server or to attempts to load as the file for want of local review. In these cases it is necessary to take advantage of ftp-access.

> The problems arise and for want of Flash and VRML Objects.