Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Lianjia Beike Spider | 2,464 | 9 months ago | 13 | Python | ||||||
链家网和贝壳网房价爬虫,采集北京上海广州深圳等21个中国主要城市的房价数据(小区,二手房,出租房,新房),稳定可靠快速!支持csv,MySQL, MongoDB,Excel, json存储,支持Python2和3,图表展示数据,注释丰富 ,点星支持,仅供学习参考,请勿用于商业用途,后果自负。 | ||||||||||
Wechat_spider | 863 | 4 years ago | 25 | JavaScript | ||||||
使用“代理”的方式来抓取微信公众账号文章,可以抓取阅读数、点赞数,基于 anyproxy。 | ||||||||||
Zhihu Spider | 128 | 5 years ago | 4 | mit | Python | |||||
一个获取知乎用户主页信息的多线程Python爬虫程序。 | ||||||||||
Youtube Watch History Scraper | 126 | 2 years ago | 9 | unlicense | Python | |||||
Scrapy YouTube watch history spider. Because YouTube didn't have a history search. | ||||||||||
Nscrapy | 82 | 2 years ago | 12 | apache-2.0 | C# | |||||
NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider | ||||||||||
Crawllagou | 69 | 3 years ago | HTML | |||||||
拉勾网爬虫 lagou spider | ||||||||||
Pythonspider | 26 | 7 years ago | Python | |||||||
:spider:some python spiders with BeautifulSoup or scarpy | ||||||||||
Wechat_spider | 16 | 7 years ago | 1 | JavaScript | ||||||
微信公众号文章爬虫,根据大神代码修改,初次获取列表需要手动下拉 | ||||||||||
Wfacat | 11 | 4 years ago | 1 | gpl-2.0 | Python | |||||
Python Spider for weibo friends analysis. (Professional Edition) / 微博用户好友人际关系网络深度分析(可使用 Gephi、Tableau 进行数据可视化)。 | ||||||||||
Crawlerutils | 9 | 5 years ago | 38 | March 25, 2019 | mit | Python | ||||
Utils for programming web crawler |