Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Lux | 24,752 | 8 | 25 days ago | 40 | November 06, 2023 | 477 | mit | Go | ||
👾 Fast and simple video download library and CLI tool written in Go | ||||||||||
Colly | 21,902 | 81 | 328 | a month ago | 22 | March 08, 2022 | 181 | apache-2.0 | Go | |
Elegant Scraper and Crawler Framework for Golang | ||||||||||
Crawlab | 10,521 | 4 months ago | 1 | March 03, 2019 | 58 | bsd-3-clause | Go | |||
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架 | ||||||||||
Katana | 7,995 | 1 | 3 months ago | 8 | September 14, 2023 | 67 | mit | Go | ||
A next-generation crawling and spidering framework. | ||||||||||
Ferret | 5,540 | 5 | 4 months ago | 56 | March 28, 2023 | 52 | apache-2.0 | Go | ||
Declarative web scraping | ||||||||||
Rod | 4,505 | 140 | 3 months ago | 406 | November 06, 2023 | 106 | mit | Go | ||
A Devtools driver for web automation and scraping | ||||||||||
Hakrawler | 4,120 | 3 months ago | 11 | February 22, 2021 | 9 | gpl-3.0 | Go | |||
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application | ||||||||||
Gau | 3,273 | 1 | 4 months ago | 31 | November 02, 2023 | 22 | mit | Go | ||
Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl. | ||||||||||
Proxypool | 3,173 | a year ago | 23 | January 19, 2021 | gpl-3.0 | Go | ||||
自动抓取tg频道、订阅地址、公开互联网上的ss、ssr、vmess、trojan节点信息,聚合去重测试可用性后提供节点列表 | ||||||||||
Crawlergo | 2,642 | 6 months ago | 2 | December 06, 2022 | 32 | gpl-3.0 | Go | |||
A powerful browser crawler for web vulnerability scanners |