Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Crawlab | 10,521 | 8 months ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go | |||
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架 | ||||||||||
Proxypool | 5,154 | 8 months ago | 40 | mit | Python | |||||
An Efficient ProxyPool with Getter, Tester and Server | ||||||||||
Gerapy | 3,144 | 8 | 8 months ago | 49 | July 19, 2023 | 60 | mit | Python | ||
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js | ||||||||||
Packtpub Crawler | 701 | 5 years ago | 15 | mit | Python | |||||
Download your daily free Packt Publishing eBook https://www.packtpub.com/packt/offers/free-learning | ||||||||||
Newcrawler | 583 | 10 months ago | 25 | JavaScript | ||||||
Free Web Scraping Tool with Java | ||||||||||
Crawljax | 493 | 28 | 6 | a year ago | 18 | June 01, 2023 | 67 | apache-2.0 | Java | |
Crawljax | ||||||||||
Browsertrix Crawler | 470 | 8 months ago | 91 | agpl-3.0 | JavaScript | |||||
Run a high-fidelity browser-based crawler in a single Docker container | ||||||||||
Scrapybook | 378 | 6 years ago | 9 | Python | ||||||
Scrapy Book Code | ||||||||||
Spidy | 287 | 2 years ago | 12 | January 25, 2018 | 11 | gpl-3.0 | Python | |||
The simple, easy to use command line web crawler. | ||||||||||
Go Movies | 232 | 9 months ago | 2 | mit | Go | |||||
golang spider Crawler 爬虫 电影 |