Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Spiderman | 498 | a year ago | 3 | mit | Python | |||||
基于 scrapy-redis 的通用分布式爬虫框架 | ||||||||||
Neocrawler | 149 | 7 years ago | 1 | other | JavaScript | |||||
Nodejs Crawler, including schedule, spider, web ui config, proxy modules. using nodejs, redis/ssdb, hbase, phantomjs. css selector extraction rules and regex extraction rules supported. |