Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for ruby spider
ruby
x
spider
x
44 search results found
Anemone
⭐
1,615
Anemone web-spider framework
Kimuraframework
⭐
874
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with JavaScript rendered websites
Spidr
⭐
775
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Device_detector
⭐
711
DeviceDetector is a precise and fast user agent parser and device detector written in Ruby
Killshot
⭐
472
A Penetration Testing Framework, Information gathering tool & Website Vulnerability Scanner
Tarantula
⭐
453
a big hairy fuzzy spider that crawls your site, wreaking havoc
Spidey
⭐
179
A loose framework for crawling and scraping web sites.
Voight Kampff
⭐
171
Voight-Kampff is a Ruby gem that detects bots, spiders, crawlers and replicants
Direct_web_spider
⭐
143
A direct web spider framworks for Ruby
Crawler_detect
⭐
106
Ruby gem to detect bots and crawlers via the user agent
Zapr
⭐
57
Easy to use command line security scanner
Useragents Rb
⭐
50
Generate a random User-Agent for you
Ronin Web
⭐
40
ronin-web is a collection of useful web helper methods and commands.
Arachnid
⭐
38
Extremely fast and efficient Ruby domain spider
Spiderpig
⭐
33
A document metadata spider.
Nanite Rails
⭐
32
easy nanite integration with rails
Spider Gazelle
⭐
30
A fast, parallel and concurrent web server for ruby
Spider_test
⭐
29
automagic integration testing for your rails app
Spider
⭐
29
Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
Spider
⭐
28
Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
Cewl
⭐
27
cewl wordlist generator from https://digi.ninja/projects/cewl.php
Wsoc
⭐
23
The Web Spider Obstacle Course
Installer
⭐
17
Installation script for Codename SCNR.
Passive Spider
⭐
17
Passive Spider uses search engines to find interesting information about a target domain.
Benchmark Http
⭐
16
Spiderman
⭐
16
your friendly neighborhood web crawler
Spidey Mongo
⭐
15
Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites.
Rb Spider
⭐
14
基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
Email_spider
⭐
14
A simple Ruby web spider that uses Anemone to crawl every page of a site looking for email addresses. Stores the results with SQLite3 using Data Mapper.
Saushengine
⭐
14
Geo Spider
⭐
13
Tool for spidering websites/blogs to extract geodata.
Amzn Scraper
⭐
9
Mechanize It
Jekyll Static Import
⭐
9
[WIP] Import static HTML websites into Jekyll
Twitter Crawler
⭐
8
web scraping
Scrapy Intro
⭐
7
Introduction to Scrapy presentation for CharPy meetup Sep. 25, 2013
Ronin Web Spider
⭐
7
A collection of common web spidering routines
Anemone_lite
⭐
7
Distributed web crawler using mongodb
Scrapinghub Ruby Example
⭐
7
Simple guide to working with Scrapinghub
Bilibilispider
⭐
6
To crawl video information from bilibili damaku site and do some analysis.
Killshot
⭐
6
Spider
⭐
5
Yet another Ruby framework
Robot
⭐
5
一切都基于你的兴趣:一个智能的信息推荐机器人
Em Crawler
⭐
5
Ruby based spider powered by eventmachine.
Pgconsole
⭐
5
pgconsole is a Web Application Assessment tool curently under development
Related Searches
Ruby Command Line (35,999)
Javascript Ruby (6,657)
Ruby Plugin (6,573)
Ruby Chef (4,661)
Ruby Testing (4,020)
Ruby Sinatra (3,377)
Ruby Rspec (3,278)
Ruby Activerecord (3,234)
Ruby Heroku (2,926)
Ruby Vagrant (2,919)
1-44 of 44 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.