Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Scraper | 96 | a year ago | 3 | mit | Python | |||||
Firmware scraper | ||||||||||
Caterpillar | 39 | 8 years ago | other | PHP | ||||||
Caterpillar is a PHP library intended for website crawling and screen scraping. It handles parallel requests using the curl_multi functions. | ||||||||||
Armslist Scraper | 31 | 8 years ago | 5 | mit | Python | |||||
A simple scraper for armslist.com listings | ||||||||||
Pttminer | 28 | 4 years ago | other | R | ||||||
Parallel Searching and Crawling Data from PTT 🚀 | ||||||||||
Selenium Grid Docker Swarm | 27 | 2 years ago | mit | Python | ||||||
web scraping in parallel with Selenium Grid and Docker | ||||||||||
Web Scraping Engine | 24 | 6 years ago | other | Haskell | ||||||
A simple web scraping engine supporting concurrent and anonymous scraping | ||||||||||
Scrapman | 20 | 2 | 6 years ago | 10 | January 27, 2017 | 1 | mit | JavaScript | ||
Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs | ||||||||||
Web_scrapers_ruby | 16 | 13 years ago | Ruby | |||||||
Samples of Web Scraper using Mechanize, Delayed Job, Parallel, Mongo, etc. | ||||||||||
Fastlinkcheck | 5 | 1 | 3 years ago | 28 | November 18, 2020 | 3 | apache-2.0 | Jupyter Notebook | ||
Check local static links and online links fast and in parallel |