Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Spider

Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
Stars
29
License
mit
Open Issues
3
Most Recent Commit
4 years ago
Programming Language
Ruby
Dependent Repos
13
Total Releases
14
Latest Release
June 04, 2020
Categories
Repo
Alternatives To Spider
Select To Compare
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96most recent commit 5 months agopypi Scrapy} Downloads
Huginn ⭐ 42,091
Create agents that monitor and act on your behalf. Your agents are standing by!
dependent packages 52total releases 8most recent commit 13 days agorubygems huginn_agent} Downloads
Cheerio ⭐ 27,702
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
dependent packages 20,519total releases 70most recent commit 3 months agonpm cheerio} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40most recent commit 3 months ago
Colly ⭐ 22,516
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22most recent commit 17 days ago
Newspaper ⭐ 13,147
News, full-text, and article metadata extraction in Python 3. Advanced docs:
dependent packages 97total releases 18most recent commit 9 months agopypi newspaper3k} Downloads
Requests Html ⭐ 13,100
Pythonic HTML Parsing for Humans™
total releases 6most recent commit a year ago
Webmagic ⭐ 11,080
A scalable web crawler framework for Java.
dependent packages 22total releases 25most recent commit 5 months ago


Suggest An Alternative To spider
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Ruby
Scraper
Spider
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.