Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Weixin_crawler | 209 | 5 years ago | JavaScript | |||||||
高效微信公众号历史文章和阅读数据爬虫powered by scrapy | ||||||||||
Bt Share | 51 | 9 years ago | 1 | mit | JavaScript | |||||
a spider which can grab some interesting things =) | ||||||||||
Scalpel | 38 | 3 months ago | 4 | June 02, 2022 | 10 | apache-2.0 | Python | |||
A fast and powerful web scraping library | ||||||||||
Pylinkchecker | 36 | 8 years ago | 1 | December 15, 2021 | 9 | other | Python | |||
standalone and pure python link checker and crawler that traverses a web site and reports errors | ||||||||||
G Crawl Py | 24 | 9 years ago | mit | Python | ||||||
Gevent Crawling in Python, with Utilities | ||||||||||
Crawler.py | 23 | 10 years ago | Python | |||||||
async web crawler | ||||||||||
Rust | 17 | 12 years ago | Python | |||||||
corroding misbehaving web bots since 2012 | ||||||||||
Ccrawler | 17 | 10 years ago | mit | Python | ||||||
A distrubuted crawler ues celery. | ||||||||||
Crawlerutils | 9 | 5 years ago | 38 | March 25, 2019 | mit | Python | ||||
Utils for programming web crawler | ||||||||||
Biu | 5 | 4 years ago | 13 | August 18, 2020 | mit | Python | ||||
biubiubiu~~ I'm a tiny web crawler framework |