Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Sparkler | 401 | a year ago | 55 | apache-2.0 | Java | |||||
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark. | ||||||||||
Jlitespider | 151 | 7 years ago | 3 | February 12, 2017 | 2 | apache-2.0 | Java | |||
A lite distributed Java spider framework :-) | ||||||||||
Golearn | 36 | 3 years ago | 4 | Go | ||||||
🔥 Golang basics and actual-combat (including: crawler, distributed-systems, data-analysis, redis, etcd, raft, crontab-task) | ||||||||||
Pider | 7 | 5 years ago | mit | PHP | ||||||
A elegant , powerful , modulized spider framework. | ||||||||||
Spider Nodejs | 6 | 2 months ago | mit | Rust | ||||||
Spider ported to Node.js | ||||||||||
Crawlersys | 6 | 7 years ago | mit | Java | ||||||
Light-weight High-performance Reliable Smart Distributed Crawler System |