ports

www/larbin

larbin-2.6.3p1 – little and fast Web crawler

Description

Larbin is a web crawler (also called (web) robot, spider, scooter...).
It is intended to fetch a large number of web pages to fill the database
of a search engine. With a network fast enough, Larbin should be able to
fetch more than 100 millions pages on a standard PC.

WWW: http://larbin.sourceforge.net/index-eng.html

Categories:
www

Library dependencies

Build dependencies

None

Run dependencies

None