Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Ruby Scrape Open Source Projects

Open source projects categorized as Ruby Scrape
Linkedin Scraper ⭐ 512
Scrapes the public profile of the linkedin page
total releases 29most recent commit 7 years ago
Hackernews ⭐ 341
There are way too many stories on Hacker News, and there's no option for "show me only the stories that Joel would like". So I built one. (Maybe "cobbled together" is more appropriate.)
most recent commit 10 years ago
Webinspector ⭐ 286
Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.
total releases 10most recent commit 7 years ago
Html2rss ⭐ 106
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
total releases 20most recent commit 4 months ago
Craigslist_scraper ⭐ 73
A gem to scrape and analyze craigslist data
total releases 2most recent commit 7 years ago
Fine Ants ⭐ 67
A gem that fetches bank accounts using Capybara
total releases 17most recent commit 2 years ago
Insta_scrape ⭐ 59
The instagram swiss army knife. Restores all deprecated hashtag functionality and grants public api access from instagram's front end without any of the authorization.
total releases 8most recent commit 4 years ago
Ledbetter ⭐ 52
Script that scrapes alert statistics from Nagios and reports them to Graphite
most recent commit 9 years ago
Kindle Your Highlights ⭐ 45
Scrape highlights from kindle.amazon.com
most recent commit 8 years ago
Libcraigscrape ⭐ 44
An easy library to do the heavy lifting between you and craigslist's posting database. Given a URL, libcraigscrape will follow links, scrape fields, and make ruby-sense out of the raw html from craigslist's servers.
most recent commit 10 years ago
Linkedindata ⭐ 37
Scrapes all LinkedIn profiles including search terms.
total releases 22most recent commit 9 years ago
Monkeyshines ⭐ 31
A simple, lightweight scraper for huffing API or feed data (rather than a page-by-page wander)
dependent packages 2total releases 5most recent commit 14 years agorubygems monkeyshines} Downloads
Grabbit ⭐ 30
Grabbit: the Facebook-style tool for scraping the title, description and best thumbnail image(s) from a given URL.
total releases 1most recent commit 10 years ago
Earl ⭐ 28
URL metadata API for scraping titles, descriptions, images, and videos from URL's.
most recent commit 15 years ago
Scrape Framework ⭐ 22
A web / screen scraper framework written in ruby that assumes scrapes should be configured, not programmed. No data is safe with the Scrape Framework on the loose!
most recent commit 2 years ago
Bnet_scraper ⭐ 22
A Nokogiri-based scraper of Battle.net profiles. Currently this only includes Starcraft2.
total releases 14most recent commit 3 years ago
Generalscraper ⭐ 22
Scrapes all pages on any site you specify for keywords.
dependent packages 1total releases 27most recent commit 7 years agorubygems generalscraper} Downloads
Galerts ⭐ 21
Ruby Google Alerts API (work with new google alerts page)
total releases 18most recent commit 8 years ago
Twfy_local_parser ⭐ 21
Local scraper parser to scrape and parse local authority data
most recent commit 15 years ago
Kindle_manager ⭐ 20
Scrape information of kindle books and highlights from amazon site
total releases 18most recent commit 9 months ago
Flatfish ⭐ 20
most recent commit 12 years ago
Kimurai ⭐ 19
Kimurai is a modern web scraping framework written in Ruby which works out of box with headless chromium/firefox, phantomjs, or simple HTTP requests and allows to scrape and interact with javascript rendered websites
most recent commit 5 years ago
Compstat_parser ⭐ 19
Parse the NYPD's weekly per-precinct crime complaints stats to CSV or MySQL
most recent commit 7 years ago
The 3 Most Depended On Ruby Scrape Open Source Projects
Throttler ⭐ 6
Rate-limits code execution across threads or processes on a server
dependent packages 3total releases 11latest release March 17, 2012most recent commit 12 years agorubygems throttler} Downloads
Monkeyshines ⭐ 31
A simple, lightweight scraper for huffing API or feed data (rather than a page-by-page wander)
dependent packages 2total releases 5latest release July 19, 2010most recent commit 14 years agorubygems monkeyshines} Downloads
Generalscraper ⭐ 22
Scrapes all pages on any site you specify for keywords.
dependent packages 1total releases 27latest release February 18, 2017most recent commit 7 years agorubygems generalscraper} Downloads
The 10 Latest Releases In Ruby Scrape Open Source Projects
Amazon_order ⭐ 10
Scrape information of amazon orders from amazon site
total releases 9latest release September 28, 2022most recent commit 9 months ago
Kindle_manager ⭐ 20
Scrape information of kindle books and highlights from amazon site
total releases 18latest release December 05, 2021most recent commit 9 months ago
Html2rss ⭐ 106
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
total releases 20latest release June 19, 2020most recent commit 4 months ago
Ncua ⭐ 5
A gem that wraps the NCUA's (unpublished) API for finding credit union information
total releases 14latest release April 25, 2018most recent commit 4 years ago
Ruby_doc ⭐ 5
A CLI Gem That Scrapes Ruby Documentation
total releases 15latest release March 22, 2018most recent commit 6 years ago
Fine Ants ⭐ 67
A gem that fetches bank accounts using Capybara
total releases 17latest release December 09, 2017most recent commit 2 years ago
G5_prom_rails ⭐ 8
Prometheus helpers for Rails
total releases 6latest release August 15, 2017most recent commit 5 years ago
Generalscraper ⭐ 22
Scrapes all pages on any site you specify for keywords.
dependent packages 1total releases 27latest release February 18, 2017most recent commit 7 years agorubygems generalscraper} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.