Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Katana | 7,995 | 1 | 3 months ago | 8 | September 14, 2023 | 67 | mit | Go | ||
A next-generation crawling and spidering framework. | ||||||||||
Ani Cli | 5,724 | 3 months ago | 15 | gpl-3.0 | Shell | |||||
A cli tool to browse and play anime | ||||||||||
Spider | 907 | 6 years ago | 3 | gpl-3.0 | Java | |||||
A configurable web spider with a easy-to-use web console | ||||||||||
Fetchbot | 758 | 3 | 3 years ago | 7 | May 20, 2021 | 2 | bsd-3-clause | Go | ||
A simple and flexible web crawler that follows the robots.txt policies and crawl delays. | ||||||||||
Xidel | 611 | 5 months ago | 18 | gpl-3.0 | Pascal | |||||
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents. | ||||||||||
Mov Cli | 314 | 1 | 3 months ago | 103 | November 25, 2023 | 32 | gpl-3.0 | Python | ||
A cli tool to browse and watch Movies/Shows/TV/Sports. | ||||||||||
Crawley | 208 | 4 months ago | 60 | December 07, 2023 | mit | Go | ||||
The unix-way web crawler | ||||||||||
Gotor | 150 | 5 months ago | 3 | November 10, 2022 | 3 | gpl-3.0 | Go | |||
This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API. | ||||||||||
Anirip | 144 | 2 years ago | 21 | mit | Go | |||||
:clapper: A Crunchyroll show/season ripper | ||||||||||
Cascadia | 128 | 10 months ago | 9 | June 30, 2023 | 1 | mit | Go | |||
Go cascadia package command line CSS selector |