Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for ruby web crawler
ruby
x
web-crawler
x
12 search results found
Spidr
⭐
775
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Morph
⭐
454
Take the hassle out of web scraping
Archivebot
⭐
328
ArchiveBot, an IRC bot for archiving websites
Awesomewebscraping
⭐
189
List of libraries, tools and APIs for web scraping and data processing.
Nokolexbor
⭐
149
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
Direct_web_spider
⭐
143
A direct web spider framworks for Ruby
Polipus
⭐
95
Polipus: distributed and scalable web-crawler framework
Hawker
⭐
70
The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL
Youtube Audio
⭐
66
extract videos from youtube in audio format using webscraping techniques 🎶
Faexport
⭐
62
The API for Furaffinity you wish existed
Clauneck
⭐
57
A tool for scraping emails, social media accounts, and much more information from websites using Google Search Results.
Slurp
⭐
54
One repo to rule them all !!?!?!! 🤓 😎
Ronin Web
⭐
40
ronin-web is a collection of useful web helper methods and commands.
Grell
⭐
36
Web crawler with a Ruby API
Linkextractor
⭐
31
A Docker tutorial using a link extraction application example
Boilerpipe Ruby
⭐
30
Pure ruby implementation of the Boilerpipe content extraction algorithm tuned for online articles
Danger Mention
⭐
29
Danger plugin to automatically mention potential reviewers on pull requests
Deviantart Gallery Downloader
⭐
25
fetch deviantart's images using mechanize
Igscraperkit
⭐
23
Create dynamic web scraper in Objective-C or Ruby!
Wsoc
⭐
23
The Web Spider Obstacle Course
Klepto
⭐
21
A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.
Halfstaff
⭐
20
🇺🇸 Is the US flag at half-staff?
Web_scrapers_ruby
⭐
16
Samples of Web Scraper using Mechanize, Delayed Job, Parallel, Mongo, etc.
Spiderman
⭐
16
your friendly neighborhood web crawler
Hsbcscraper
⭐
14
Web scraper for downloading statements from HSBC Business Banking
Web_scraper_ruby
⭐
13
The program is implementing a scraper for search results of a job offers website. This scraper helps you to search by keywords on https://www.indeed.com webpage, to scrape the results and to display them in the terminal, or export it into a CSV or a Text files.
Google Local Results Ai Parser
⭐
12
A ruby gem to extract structured data from Google Local Search Results using the serpapi/bert-base-local-results model, enabling parsing, classification, and information extraction from English HTML content.
Wgit
⭐
10
Wgit allows you to crawl and extract the data you want from the web
Grubby
⭐
10
Fail-fast web scraping
Scrape
⭐
9
When you need those jobs hypersonic 🚀 scrape 🔪
Myfitnesspal_stats
⭐
9
Get access to your daily MyFitnessPal data!
Webrat Scraper
⭐
9
A web scraper using Webrat::MechanizeSession - does acceptance-based web scraping relying on the great webrat behavior description language.
Socials_regex
⭐
8
🪡 Social account detection and extraction in ruby, e.g. for crawling/scraping.
Mtg Db
⭐
8
Ruby gem containing structured data for all Magic: The Gathering cards
Arachnid2
⭐
8
a simple, fast web-crawler written in Ruby using Watir or Typhoeus
Anemone_lite
⭐
7
Distributed web crawler using mongodb
Globo_play_scraper
⭐
6
When the App is executed, the user is prompted to type keywords. Then the App will search in Globo Play and create an HTML file with all of the results found!
Cnyi
⭐
6
LITG Project in RoR.
Goodwill
⭐
6
Basic interactions for ShopGoodwill.com
Sgshowtimesapi
⭐
5
Scrapes Singapore movie showtimes
Ruby Web Scraper
⭐
5
A web scraper made with Ruby
Webscraping With Ruby
⭐
5
A tutorial for web scraping with Ruby
Albumkey
⭐
5
Pitchfork Analyst Tool
System Call
⭐
5
A web scraper and Ruby gem to generate a 📄 list of system calls in UNIX based system
Related Searches
Ruby Command Line (35,999)
Ruby Plugin (6,573)
Javascript Ruby (6,099)
Ruby Chef (4,661)
Ruby Testing (4,020)
Ruby Sinatra (3,377)
Ruby Rspec (3,278)
Ruby Activerecord (3,234)
Ruby Vagrant (2,991)
Ruby Heroku (2,928)
1-12 of 12 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.