Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Creeper | 762 | 8 years ago | 1 | May 16, 2017 | 4 | apache-2.0 | Go | |||
:paw_prints: Creeper - The Next Generation Crawler Framework (Go) | ||||||||||
Spidermonkey | 105 | 13 years ago | PHP | |||||||
DEFUNCT: PHP Web Spider from 2011 | ||||||||||
Nipper | 65 | 3 | 4 years ago | 10 | March 12, 2021 | 4 | other | Rust | ||
A Rust crate for manipulating HTML with CSS selectors | ||||||||||
Spider Pig | 55 | 5 | 3 | 3 years ago | 6 | December 06, 2021 | 8 | mit | JavaScript | |
Get a list of local URL links from a root URL. | ||||||||||
Web Data Extractor | 54 | 2 years ago | 2 | apache-2.0 | Java | |||||
Extracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON. | ||||||||||
Portia2code | 39 | 13 | 7 years ago | 14 | March 27, 2018 | 6 | other | Python | ||
Cl Spider | 13 | 3 years ago | gpl-2.0 | Common Lisp | ||||||
A Common Lisp Spider for the Web | ||||||||||
Python Webcrawling | 12 | 8 years ago | Python | |||||||
파이썬 웹크롤링 | ||||||||||
Spidersharp | 11 | 6 years ago | 24 | April 10, 2019 | mit | C# | ||||
Web Crawling and Scraping Framework | ||||||||||
Scrapio | 7 | 5 years ago | 7 | May 04, 2020 | apache-2.0 | Go | ||||
Simple and easy-to-use scraper and crawler in Go. |