Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for ruby scrape
ruby
x
scrape
x
85 search results found
Linkedin Scraper
⭐
512
Scrapes the public profile of the linkedin page
Hackernews
⭐
341
There are way too many stories on Hacker News, and there's no option for "show me only the stories that Joel would like". So I built one. (Maybe "cobbled together" is more appropriate.)
Webinspector
⭐
286
Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.
Html2rss
⭐
106
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
Craigslist_scraper
⭐
73
A gem to scrape and analyze craigslist data
Fine Ants
⭐
67
A gem that fetches bank accounts using Capybara
Insta_scrape
⭐
59
The instagram swiss army knife. Restores all deprecated hashtag functionality and grants public api access from instagram's front end without any of the authorization.
Ledbetter
⭐
52
Script that scrapes alert statistics from Nagios and reports them to Graphite
Kindle Your Highlights
⭐
45
Scrape highlights from kindle.amazon.com
Libcraigscrape
⭐
44
An easy library to do the heavy lifting between you and craigslist's posting database. Given a URL, libcraigscrape will follow links, scrape fields, and make ruby-sense out of the raw html from craigslist's servers.
Linkedindata
⭐
37
Scrapes all LinkedIn profiles including search terms.
Monkeyshines
⭐
31
A simple, lightweight scraper for huffing API or feed data (rather than a page-by-page wander)
Grabbit
⭐
30
Grabbit: the Facebook-style tool for scraping the title, description and best thumbnail image(s) from a given URL.
Earl
⭐
28
URL metadata API for scraping titles, descriptions, images, and videos from URL's.
Scrape Framework
⭐
22
A web / screen scraper framework written in ruby that assumes scrapes should be configured, not programmed. No data is safe with the Scrape Framework on the loose!
Bnet_scraper
⭐
22
A Nokogiri-based scraper of Battle.net profiles. Currently this only includes Starcraft2.
Generalscraper
⭐
22
Scrapes all pages on any site you specify for keywords.
Galerts
⭐
21
Ruby Google Alerts API (work with new google alerts page)
Twfy_local_parser
⭐
21
Local scraper parser to scrape and parse local authority data
Kindle_manager
⭐
20
Scrape information of kindle books and highlights from amazon site
Flatfish
⭐
20
Kimurai
⭐
19
Kimurai is a modern web scraping framework written in Ruby which works out of box with headless chromium/firefox, phantomjs, or simple HTTP requests and allows to scrape and interact with javascript rendered websites
Compstat_parser
⭐
19
Parse the NYPD's weekly per-precinct crime complaints stats to CSV or MySQL
Map Gather
⭐
18
Scrape a ArcGIS Rest API feature layer
Xray
⭐
18
Transparency for Web Services
Adwords_scraper
⭐
18
scraping google adwords ads
Advanced Web Scraping
⭐
17
Freelance Job Scraper
⭐
16
This is a freelance job scraper built using Ruby by following OOP. It takes keywords from the user input, scrapes 3 job sites and exports them to 3 separate CSV files.
Uk_planning_scraper
⭐
16
A Ruby gem to get planning applications data from UK council websites.
Google Seo Allintitle Scraper
⭐
15
Google SEO scraper for "allintitle:keyword" queries.
Ffffound Mirror
⭐
13
scripts to scrape/mirror metadata (and maybe images?) from ffffound
Flickr_airlift
⭐
12
A command line tool to scrape all of a user's photos.
Golfscrape
⭐
11
Ruby class to scrape PGA Tour golf data
Shodan_scrape
⭐
11
This script allow to scrape shodan.io IoT search engine and get devices IP without using your search or download credit!
Classifieds
⭐
10
Rails application that allows me to scrape the classified ads of my local newspaper and automate the process of searching for something in particular, I can create alerts and the system will send me an email when there is a match
Amazon_order
⭐
10
Scrape information of amazon orders from amazon site
Tvdb Scraper
⭐
10
Scrapes TV metadata from thetvdb
Faculty Scraper
⭐
10
A tool to scrape the faculty details of QS Top 30 Institutes.
Hbase Scripts
⭐
10
Diagnostic and repair scripts for hbase administrators
Yelp
⭐
10
A rails project to scrape yelp. And scrape yelp. And scrape yelp, ad infinitum!
Webdriver On Ec2 Example
⭐
9
Uses WebDriver on a headless Amazon EC2 instance to scrape videos from Railscasts.
Translink
⭐
9
Scrapes public transport data from TransLink into GTFS
Twitter Scraper
⭐
9
A scraper that uses the twitter API to download pertinent data to text files
Tess_scrapers
⭐
9
TeSS HTML page scrapers in Ruby looking for training resources and events metadata.
Scrape
⭐
9
When you need those jobs hypersonic 🚀 scrape 🔪
Plentyofstats
⭐
8
Gatherer
⭐
8
Gatherer: The Magicking scrapes Magic: The Gathering card data from http://gatherer.wizards.com.
Rubyscholar
⭐
8
Scrape Google Scholar Profile into a custom HTML using Ruby (Nokogiri)
Page To Html Converter
⭐
8
An app that scrapes a url and return the page's HTML source, without including HTML presentation attributes
Facebook Profile Scraper
⭐
8
Scrape Facebook profiles without the Open Graph API
Scrape Linkedin
⭐
8
Small project created to scrape data from Linkedin for a research project
Nhkore
⭐
8
🇯🇵📰🗻 NHK News Web (Easy) word frequency (core list) scraper for Japanese language learners.
Statsd Rabbitmq
⭐
8
Scrape some base info out of rabbitmq and shove it into statsd (running on localhost)
Stretched.io
⭐
8
a JSON/Ruby web scraping PaaS
G5_prom_rails
⭐
8
Prometheus helpers for Rails
Rubygem_miner
⭐
7
This script will look for basic vulnerabilities in ruby gems, it scrapes ruby gems.org for all gems that begin with letter $argument
Schedule Scrape
⭐
7
Scrapes online schedules (pointstreak.com at this time) and provides portable versions
Bixi
⭐
7
Scrape Bixi station data and return it as JSON
Intercom Articles Scraper
⭐
7
Basic page scraper and read-only API for Intercom Help Center.
Moving_summonses_parser
⭐
7
Cuporter
⭐
7
Scrape Cucumber feature files to report on tag usage, listing Feature and Scenario names per tag.
Delicious_inbox_exporter
⭐
7
Ruby script to export (scrape) your Delicious inbox
Schema.org_scraper
⭐
7
Scrapes the schema.org site and returns the datatypes and vocabulaires in machine readable formats
Cantonese Syllables
⭐
7
Scrape cantonese syllables from CUHK Multi-function Chinese Character Database.
Delicious_scraper
⭐
7
little ruby script to scrape delicious bookmarks
Case_scraper
⭐
6
Scrape case citations from legal briefs in rtf format.
Shelfari
⭐
6
[deprecated] Ruby gem that simulates an API for the shelfari.com website
Ovchipkaart
⭐
6
Unofficial Ruby OV Chipkaart API gem
Dvd_scrape
⭐
6
Fetches a CSV file containing DVD information from the web, parses it, saves it to a database, and scrapes the web for cover art.
Scrapix
⭐
6
Your friendly Image Scraper. Currently, supported: Google Images, vBulletin Threads
Throttler
⭐
6
Rate-limits code execution across threads or processes on a server
Nhk Scraper
⭐
6
This script scrapes the NHK 高校講座 video library, downloads them, and reencodes them for iPad.
Scrapist
⭐
6
Simple API for Scraping HTML via Sinatra and Wombat
Sgshowtimesapi
⭐
5
Scrapes Singapore movie showtimes
Hsbc_crawler
⭐
5
A quick and dirty web crawler to scrape my bank statements from HSBC. Unfortunately written just before they changed their design.
Flick_scrape_halfhour
⭐
5
Scrappet Rest Api
⭐
5
rails app for web scraping purposes. It scrapes a given page (by the URL), and returns you all informations about that page.
Ruby_doc
⭐
5
A CLI Gem That Scrapes Ruby Documentation
Bagelbox
⭐
5
Scrape torrent sites, ftp and directories for downloadable (media) content and download stuff that matches what you want.
Css_parser
⭐
5
hpricot helper that scrapes html easily by parser class defined css selector
Buienalarm
⭐
5
Super-simple library to scrape Buienalarm.nl for projected rainfall.
Crypto Scraper
⭐
5
CryptoScraper is a custom web scraper that extracts data from CoinMarketCap , and exports it to a spreadsheet for easy access and analysis. Project was build entirely using Ruby.
Imw_twitter_friends
⭐
5
Tools for exploring the Twitter friend graph
Igscraper
⭐
5
Scrape Instagram posts from an user or hashtag 👀
Ncua
⭐
5
A gem that wraps the NCUA's (unpublished) API for finding credit union information
Related Searches
Ruby Command Line (35,999)
Javascript Ruby (6,657)
Ruby Plugin (6,573)
Ruby Chef (4,661)
Ruby Testing (4,020)
Ruby Sinatra (3,377)
Ruby Rspec (3,278)
Ruby Activerecord (3,234)
Ruby Heroku (2,926)
Ruby Vagrant (2,919)
1-85 of 85 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.