Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Gocrawl | 1,929 | 1 | 3 years ago | 9 | May 20, 2021 | 5 | bsd-3-clause | Go | ||
Polite, slim and concurrent web crawler. | ||||||||||
Go_spider | 1,629 | 2 | 6 years ago | 1 | August 09, 2015 | 18 | mpl-2.0 | Go | ||
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only. | ||||||||||
Webcrawler | 25 | 4 years ago | 2 | May 29, 2018 | mit | Python | ||||
A web crawler based on requests-html, mainly targets for url validation test. | ||||||||||
Rust | 17 | 12 years ago | Python | |||||||
corroding misbehaving web bots since 2012 | ||||||||||
Octopus | 11 | 4 months ago | 28 | October 19, 2022 | 3 | PHP | ||||
Sitemap checker/stress test tool based on ReactPHP | ||||||||||
Natto | 11 | 4 years ago | May 28, 2021 | 2 | Go | |||||
A simple command-line web crawler. | ||||||||||
Hoopa | 7 | 6 years ago | JavaScript | |||||||
A crawler made by programmers, for programmers | ||||||||||
Go Webcrawler | 7 | 8 years ago | 1 | August 27, 2016 | mit | Go | ||||
a simple, concurrent , distributed, go-implemented web crawler framework. | ||||||||||
Spidergo | 6 | 8 years ago | 1 | February 23, 2016 | 1 | mit | Go | |||
:beetle: A spider(crawler) written in go. | ||||||||||
Aiospider | 6 | 5 years ago | mit | Python | ||||||
Use asyncio and aiohttp write a little spider |