Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Cobweb

Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
Stars
221
License
mit
Open Issues
17
Most Recent Commit
4 years ago
Programming Language
JavaScript
Total Downloads
rubygems cobweb Downloads
Dependent Repos
15
Dependent Packages
5
Total Releases
94
Latest Release
January 09, 2021
Categories
Repo
Alternatives To Cobweb
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Cobweb221rubygems cobweb} Downloads1554 years ago94January 09, 202117mitJavaScript
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
Cobweb_sample7
11 years ago3Ruby
Sample rails app that utilises cobweb with resque
Alternatives To Cobweb
Select To Compare


Suggest An Alternative To cobweb
Alternative Project Comparisons
Cobweb vs Cobweb_sample
Popular Crawler Projects
Scrapy ⭐ 49,918
Scrapy, a fast high-level web crawling & scraping framework for Python.
dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months agopypi Scrapy} Downloads
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 24 days ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Popular Resque Projects
Resque ⭐ 9,357
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
dependent packages 499total releases 77latest release August 19, 2023most recent commit 5 months agorubygems resque} Downloads
Php Resque ⭐ 3,425
PHP port of resque (Workers and Queueing)
dependent packages 61total releases 1latest release October 13, 2012most recent commit 5 years agopackagist chrisboulton/php-resque} Downloads
Peek ⭐ 3,114
Take a peek into your Rails applications.
dependent packages 28total releases 16latest release September 27, 2019most recent commit 4 years agorubygems peek} Downloads
Exq ⭐ 1,425
Job processing library for Elixir - compatible with Resque / Sidekiq
dependent packages 11total releases 57latest release July 21, 2023most recent commit 9 months agohex exq} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Javascript
Hash
Crawler
Resque
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.