Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Hawk | 2,638 | 4 years ago | 65 | apache-2.0 | C# | |||||
visualized crawler & ETL IDE written with C#/WPF | ||||||||||
Pywebcopy | 455 | 1 | 2 | 4 months ago | 21 | April 27, 2022 | 21 | other | Python | |
Locally saves webpages to your hard disk with images, css, js & links as is. | ||||||||||
Iclr2020 Openreviewdata | 355 | 4 years ago | 2 | mit | Jupyter Notebook | |||||
Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu. | ||||||||||
Spidy | 287 | 2 years ago | 12 | January 25, 2018 | 11 | gpl-3.0 | Python | |||
The simple, easy to use command line web crawler. | ||||||||||
Selenops | 215 | 3 years ago | mit | Swift | ||||||
A Swift Web Crawler 🕷 | ||||||||||
Python Email Crawler | 213 | 6 years ago | 19 | Python | ||||||
Search on Google, and crawls for emails related to the result | ||||||||||
Warcreate | 187 | 5 months ago | 58 | mit | JavaScript | |||||
Chrome extension to "Create WARC files from any webpage" | ||||||||||
Chrome Crawler | 59 | 6 years ago | JavaScript | |||||||
An extension for google chrome that lets a use crawl a webpage for files and links | ||||||||||
Goscraper | 58 | 2 | 6 | 4 years ago | 1 | August 27, 2019 | 3 | mit | Go | |
Golang pkg to quickly return a preview of a webpage (title/description/images) | ||||||||||
Spiderq | 50 | 11 years ago | other | C++ | ||||||
web spider |