Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Easy S3 Kafka Consumer

Pain-free system for sinking data from kafka to s3. Written in Go for high concurrency. Great for streaming large amounts of web data into s3 for use with mapreduce.
Stars
6
License
No license specified
Open Issues
0
Most Recent Commit
10 years ago
Programming Language
Python
Categories
Repo
Alternatives To Easy S3 Kafka Consumer
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Summingbird2,1171132 years ago36June 23, 2016163apache-2.0Scala
Streaming MapReduce with Scalding and Storm
Mobius937
63 months ago22January 29, 201788mitC#
C# and F# language binding and extensions to Apache Spark
Hackathon114
7 years ago1mitJava
Library and resources for hack/reduce Hackathon events
Pyxtension36pypi pyxtension} Downloads25 months ago54November 05, 20238mitPython
Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
Haskell_hadoop34
11 years agozlibHaskell
Haskell module for streaming hadoop MapReduce jobs
Mossrose32236 years ago35June 15, 2018Java
Light Distributed Job Framework
Efflux31
a year ago7January 15, 20191mitRust
Easy Hadoop Streaming and MapReduce interfaces in Rust
Rosetta Scone25
12 years ago1Ruby
A collection of MapReduce tasks translated (from Pig, Hive, MapReduce streaming, Cascalog, etc.) into Scalding.
Zephyr21
8 years ago3apache-2.0Java
Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.
Data Pipeline Project18
2 years agoJupyter Notebook
Data pipeline project
Alternatives To Easy S3 Kafka Consumer
Select To Compare
Summingbird ⭐ 2,117
Streaming MapReduce with Scalding and Storm
dependent packages 13total releases 36most recent commit 2 years ago
Mobius ⭐ 937
C# and F# language binding and extensions to Apache Spark
total releases 22most recent commit 3 months ago
Mossrose ⭐ 32
Light Distributed Job Framework
dependent packages 3total releases 35most recent commit 6 years ago


Suggest An Alternative To easy-s3-kafka-consumer
Alternative Project Comparisons
Easy S3 Kafka Consumer vs Summingbird
Easy S3 Kafka Consumer vs Mobius
Easy S3 Kafka Consumer vs Hackathon
Easy S3 Kafka Consumer vs Pyxtension
Easy S3 Kafka Consumer vs Haskell_hadoop
Easy S3 Kafka Consumer vs Mossrose
Easy S3 Kafka Consumer vs Efflux
Easy S3 Kafka Consumer vs Rosetta Scone
Easy S3 Kafka Consumer vs Zephyr
Easy S3 Kafka Consumer vs Data Pipeline Project
Popular Mapreduce Projects
Powerjob ⭐ 6,249
Enterprise job scheduling middleware with distributed computing ability.
dependent packages 5total releases 13latest release September 03, 2023most recent commit 3 months ago
Popular Streaming Projects
Webtorrent ⭐ 28,972
⚡️ Streaming torrent client for the web
dependent packages 184total releases 494latest release November 30, 2023most recent commit 4 days agonpm webtorrent} Downloads
Flink ⭐ 22,747
Apache Flink
dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Streaming
Kafka
S3
Mapreduce
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.