Go Webcrawler
a simple, concurrent , distributed, go-implemented web crawler framework.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Gocrawl | 1,929 | 1 | 3 years ago | 9 | May 20, 2021 | 5 | bsd-3-clause | Go | ||
| Polite, slim and concurrent web crawler. | ||||||||||
| Go_spider | 1,629 | 2 | 7 years ago | 1 | August 09, 2015 | 18 | mpl-2.0 | Go | ||
| [爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only. | ||||||||||
| Webcrawler | 25 | 4 years ago | 2 | May 29, 2018 | mit | Python | ||||
| A web crawler based on requests-html, mainly targets for url validation test. | ||||||||||
| Rust | 17 | 12 years ago | Python | |||||||
| corroding misbehaving web bots since 2012 | ||||||||||
| Octopus | 11 | 4 months ago | 28 | October 19, 2022 | 3 | PHP | ||||
| Sitemap checker/stress test tool based on ReactPHP | ||||||||||
| Natto | 11 | 4 years ago | May 28, 2021 | 2 | Go | |||||
| A simple command-line web crawler. | ||||||||||
| Hoopa | 7 | 7 years ago | JavaScript | |||||||
| A crawler made by programmers, for programmers | ||||||||||
| Go Webcrawler | 7 | 8 years ago | 1 | August 27, 2016 | mit | Go | ||||
| a simple, concurrent , distributed, go-implemented web crawler framework. | ||||||||||
| Spidergo | 6 | 8 years ago | 1 | February 23, 2016 | 1 | mit | Go | |||
| :beetle: A spider(crawler) written in go. | ||||||||||
| Aiospider | 6 | 5 years ago | mit | Python | ||||||
| Use asyncio and aiohttp write a little spider | ||||||||||
Alternatives To Go WebcrawlerSelect To Compare
Alternative Project Comparisons
Popular Crawler Projects
Popular Concurrent Projects
Popular Data Processing Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Golang
Sql
Crawler
Concurrent