Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Crawlab | 10,521 | 3 months ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go | |||
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架 | ||||||||||
Gerapy | 3,144 | 8 | 3 months ago | 49 | July 19, 2023 | 60 | mit | Python | ||
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js | ||||||||||
Core | 2,667 | 3 years ago | 6 | mit | JavaScript | |||||
🔞 JAVClub - 让你的大姐姐不再走丢 | ||||||||||
Wechat_spider | 1,236 | 10 months ago | 28 | mit | JavaScript | |||||
微信爬虫,获取文章内容、阅读量、点赞量、评论等,获取公众号所有历史文章链接。 | ||||||||||
Zhihu_spider | 855 | 8 years ago | 8 | Python | ||||||
知乎爬虫 | ||||||||||
602 | 3 months ago | 81 | other | Python | ||||||
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy | ||||||||||
Newcrawler | 583 | 5 months ago | 25 | JavaScript | ||||||
Free Web Scraping Tool with Java | ||||||||||
Qqzonemood | 499 | a year ago | mit | Python | ||||||
QQZone mood spider and analysis. QQ空间多线程爬虫和数据挖掘。提供线上服务,扫码登陆即可自动爬取和分析数据,还有网易云年度报告风格的数据展示;使用docker-compose打包程序,方便部署;额外提供QQ空间抽奖小程序。 | ||||||||||
Newscrawl | 402 | 3 months ago | 6 | Python | ||||||
狠心开源企业级舆情新闻爬虫项目:支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除;爬虫一键部署;爬虫监控可视化; 配置集群爬虫分配策略;👉 现成的docker一键部署文档已为大家踩坑 | ||||||||||
Scrapybook | 378 | 6 years ago | 9 | Python | ||||||
Scrapy Book Code |