Index of /ports_www/webcrawl

Icon  Name                    Last modified      Size  
[DIR] Parent Directory - [   ] Makefile 06-Feb-2004 16:12 672 [   ] distinfo 28-May-2011 14:16 127 [DIR] files/ 25-Dec-2006 04:08 - [TXT] pkg-descr 04-Feb-1999 00:26 312
WebCrawl is a program designed to download an entire web-site without
user interaction (although an interactive mode is available). It works simply
by starting with a single web page, and following all links from that page
to attempt to recreate the directory structure on the remote server.

--Dima
dima@chg.ru