Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Php Spider | 1,316 | 11 | 6 | 4 months ago | 17 | August 14, 2023 | 3 | mit | PHP | |
A configurable and extensible PHP web spider | ||||||||||
Arachnid | 80 | 2 years ago | 1 | mit | Crystal | |||||
Powerful web scraping framework for Crystal | ||||||||||
Courlan | 55 | 5 | 3 months ago | 25 | November 28, 2023 | 13 | gpl-3.0 | Python | ||
Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters | ||||||||||
Bear.resource | 45 | 59 | 16 | 4 months ago | 125 | August 22, 2023 | 2 | mit | PHP | |
A hypermedia framework for an object as a service | ||||||||||
Seenreq | 32 | 148 | 11 | 5 years ago | 26 | April 15, 2019 | 3 | mit | JavaScript | |
Generate an object for testing if a request is sent, request is Mikeal's request. | ||||||||||
The Gatherer | 12 | 8 years ago | mit | Ruby | ||||||
Ruby based framework to streamline data collection, storage and analysis tasks. | ||||||||||
Sharetary | 7 | 1 | 9 years ago | 5 | June 16, 2015 | 14 | JavaScript | |||
Archives any topic about a technical conference and provides a cross-origin timeline view in real time. | ||||||||||
Cangrejo Gem | 6 | 1 | 8 years ago | 24 | March 30, 2016 | 2 | mit | Ruby | ||
Crabfarm ruby client | ||||||||||
Ftp Crawler | 6 | 6 years ago | 1 | C# | ||||||
Basic file crawler written for fun. | ||||||||||
Nyrr_scrapy | 6 | 12 years ago | Python | |||||||
NYRR race result scraper. Scrapes both the entire nyrr race database as well as the member database. |