Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Fetchbot | 758 | 3 | 3 years ago | 7 | May 20, 2021 | 2 | bsd-3-clause | Go | ||
A simple and flexible web crawler that follows the robots.txt policies and crawl delays. | ||||||||||
Ant | 271 | a year ago | 8 | April 05, 2021 | 2 | mit | Go | |||
A web crawler for Go | ||||||||||
Pagser | 91 | 5 | 6 months ago | 3 | October 15, 2023 | 6 | mit | Go | ||
Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler | ||||||||||
Structominer | 17 | 10 years ago | 1 | April 19, 2014 | 7 | mit | Python | |||
Data scraping for a more civilized age |