Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Creeper | 762 | 7 years ago | 1 | May 16, 2017 | 4 | apache-2.0 | Go | |||
:paw_prints: Creeper - The Next Generation Crawler Framework (Go) | ||||||||||
Scrapple | 452 | 1 | 5 years ago | 10 | September 24, 2016 | 4 | mit | Python | ||
A framework for creating semi-automatic web content extractors | ||||||||||
Hquery.php | 345 | 1 | 4 | 3 months ago | 23 | July 19, 2019 | 15 | mit | PHP | |
An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies. | ||||||||||
Ruiji.net | 261 | 4 months ago | 21 | August 21, 2020 | 14 | lgpl-3.0 | C# | |||
crawler framework, distributed crawler extractor | ||||||||||
Graphquery | 104 | 3 | 4 | 5 years ago | 1 | March 17, 2019 | apache-2.0 | Go | ||
GraphQuery is a query language and execution engine tied to any backend service. | ||||||||||
Skrap | 98 | 2 | 10 years ago | 2 | February 09, 2014 | 1 | mit | CoffeeScript | ||
Easily scrap web pages by providing json recipes | ||||||||||
Sitequery | 50 | 3 | 1 | 12 years ago | 19 | March 24, 2012 | 1 | JavaScript | ||
A node.js module for reactive webcrawling | ||||||||||
Jason The Miner | 40 | 3 | 2 years ago | 13 | June 01, 2020 | 4 | mit | JavaScript | ||
⛏ A versatile Web scraper for Node.js | ||||||||||
Portia2code | 39 | 13 | 6 years ago | 14 | March 27, 2018 | 6 | other | Python | ||
Resolver | 30 | 2 | 3 years ago | 4 | March 10, 2020 | JavaScript | ||||
a crawler tool more infomation http://tseian.com/wordpress/?p=244 |