Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Jirlbot

Java implementation of the Internet Research Lab Web Crawler (IRLbot) as presented by Hsin-Tsang Lee, Derek Leonard, Xiaoming Wang, and Dmitri Loguinov in their paper "IRLbot: Scaling to 6 Billion Pages and Beyond"
Stars
8
License
No license specified
Open Issues
0
Most Recent Commit
7 years ago
Programming Language
Java
Categories
Repo
Alternatives To Jirlbot
Select To Compare
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 4 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40most recent commit 2 months ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22most recent commit 2 months ago
Pyspider ⭐ 15,943
A Powerful Spider(Web Crawler) System in Python.
dependent packages 2total releases 17most recent commit 10 months agopypi pyspider} Downloads
Newspaper ⭐ 13,147
News, full-text, and article metadata extraction in Python 3. Advanced docs:
dependent packages 97total releases 18most recent commit 8 months agopypi newspaper3k} Downloads


Suggest An Alternative To JIRLbot
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Java
Crawler
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.