Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Crawlab | 10,521 | 3 months ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go | |||
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架 | ||||||||||
Portia | 8,982 | 9 | 2 | 7 months ago | 26 | May 25, 2015 | 127 | bsd-3-clause | Python | |
Visual scraping for Scrapy | ||||||||||
Gerapy | 3,144 | 8 | 2 months ago | 49 | July 19, 2023 | 60 | mit | Python | ||
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js | ||||||||||
Zhihu_spider | 855 | 8 years ago | 8 | Python | ||||||
知乎爬虫 | ||||||||||
House Renting | 768 | 2 years ago | 9 | apache-2.0 | Python | |||||
Possibly the best practice of Scrapy 🕷 and renting a house 🏡 | ||||||||||
Jd_spider | 728 | 5 years ago | 2 | Python | ||||||
Two dumb distributed crawlers | ||||||||||
Scrapydouban | 646 | 4 months ago | 6 | Python | ||||||
豆瓣电影/豆瓣读书 Scarpy 爬虫 | ||||||||||
602 | 2 months ago | 81 | other | Python | ||||||
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy | ||||||||||
Newscrawl | 402 | 3 months ago | 6 | Python | ||||||
狠心开源企业级舆情新闻爬虫项目:支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除;爬虫一键部署;爬虫监控可视化; 配置集群爬虫分配策略;👉 现成的docker一键部署文档已为大家踩坑 | ||||||||||
Scrapybook | 378 | 6 years ago | 9 | Python | ||||||
Scrapy Book Code |