This is the public repository of BUbiNG, the next generation web crawler from the Laboratory of Web Algorithmics; on the lab website you can find the API and configuration documentation, and instructions on how to stop from accessing your site.
rcourivaud / bubing Goto Github PK
View Code? Open in Web Editor NEWThis project forked from law-unimi/bubing
The LAW next generation crawler.
Home Page: http://law.di.unimi.it/software.php#bubing
License: Apache License 2.0