Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Colly | 22,516 | 81 | 328 | 16 days ago | 22 | March 08, 2022 | 181 | apache-2.0 | Go | |
Elegant Scraper and Crawler Framework for Golang | ||||||||||
Easyspider | 20,149 | 3 months ago | 6 | other | JavaScript | |||||
A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。 | ||||||||||
Proxy_pool | 19,442 | 6 months ago | 273 | mit | Python | |||||
Python ProxyPool for web spider | ||||||||||
Pyspider | 15,943 | 30 | 2 | a year ago | 17 | April 18, 2018 | 297 | apache-2.0 | Python | |
A Powerful Spider(Web Crawler) System in Python. | ||||||||||
Examples Of Web Crawlers | 13,142 | 6 months ago | 18 | mit | Python | |||||
一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、微信读书、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. ) | ||||||||||
Crawlab | 10,521 | 6 months ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go | |||
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架 | ||||||||||
Photon | 10,244 | 5 | 6 months ago | 18 | January 25, 2019 | 52 | gpl-3.0 | Python | ||
Incredibly fast crawler designed for OSINT. | ||||||||||
Avbook | 8,777 | a year ago | 85 | PHP | ||||||
AV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database | ||||||||||
Spider Flow | 8,075 | a year ago | 20 | mit | Java | |||||
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。 | ||||||||||
Infospider | 6,856 | 9 months ago | 8 | gpl-3.0 | Python | |||||
INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰,旨在安全快捷的帮助用户拿回自己的数据,工具代码开源,流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。 |