Index of /ports_www/larbin

Icon  Name                    Last modified      Size  
[DIR] Parent Directory                             -   
[   ] Makefile                28-Apr-2008 18:16  2.0K  
[   ] distinfo                28-May-2011 14:14  132   
[DIR] files/                  25-Dec-2006 04:08    -   
[TXT] pkg-descr               29-Mar-2002 13:54  818   
[   ] pkg-plist               29-Mar-2002 13:54  232   

Larbin is a powerful web crawler (also called [web] robot, spider...).  It
is intended to fetch a large number of web pages to fill the database of a
search engine.  With a network fast enough, Larbin is able to fetch more than
100 million pages on a standard PC.

Larbin was initially developed for the XYLEME project in the VERSO team at
INRIA.  The goal of Larbin was to go and fetch XML pages on the web to fill
the database of an xml-oriented search engine.

The following can be done with Larbin:

	o A crawler for a search engine
	o A crawler for a specialized search enginer (xml, images, mp3...)
	o Statistics on the web (about servers or page contents)

Larbin is created by: Sebastien Ailleret

WWW: http://larbin.sourceforge.net
WWW: http://www.sourceforge.net/projects/larbin
WWW: http://www.ailleret.com