Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Kafka Apache Spark Open Source Projects

Open source projects categorized as Kafka Apache Spark
Categories > Data Processing > Apache Spark
Oryx ⭐ 1,793
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
dependent packages 2total releases 14most recent commit 3 years ago
Kafka Storm Starter ⭐ 729
[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
most recent commit 2 years ago
Awesome Kafka ⭐ 549
A list about Apache Kafka
most recent commit 7 months ago
Agile_data_code_2 ⭐ 435
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
most recent commit a year ago
Wirbelsturm ⭐ 333
[PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
most recent commit 2 years ago
Data Accelerator ⭐ 293
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
dependent packages 7total releases 26most recent commit 11 days agonpm datax-common} Downloads
Azure Event Hubs Spark ⭐ 225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
total releases 68most recent commit a year ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Example Spark Kafka ⭐ 118
Apache Spark and Apache Kafka integration example
most recent commit 6 years ago
Spark Atlas Connector ⭐ 112
A Spark Atlas connector to track data lineage in Apache Atlas
most recent commit 4 years ago
Learning Spark ⭐ 94
Practical examples of using Apache Spark in several different use cases
most recent commit 8 years ago
Qstreaming ⭐ 89
A simplified, lightweight ETL pipeline framework for build stream/batch processing applications on top of Apache Spark
total releases 5most recent commit 3 years ago
Euphoria ⭐ 74
Euphoria is an open source Java API for creating unified big-data processing flows. It provides an engine independent programming model which can express both batch and stream transformations.
total releases 4most recent commit 3 years ago
Lambda Arch Spark ⭐ 63
most recent commit 4 years ago
Kafka Streaming Click Analysis ⭐ 56
Use Kafka and Apache Spark streaming to perform click stream analytics
most recent commit 4 years ago
Awesome Pulsar ⭐ 53
A curated list of Pulsar tools, integrations and resources.
most recent commit 3 years ago
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8most recent commit a year ago
Real Time Stream Processing Engine ⭐ 37
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
most recent commit 8 years ago
Apache Spark 2 For Beginners ⭐ 33
Apache Spark 2 for Beginners, published by Packt
most recent commit a year ago
Spark Twitter Sentiment Analysis ⭐ 33
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
most recent commit 5 years ago
Almaren Framework ⭐ 28
The Almaren Framework provides a simplified consistent minimalistic layer over Apache Spark. While still allowing you to take advantage of native Apache Spark features. You can still combine it with standard Spark code.
dependent packages 3total releases 51most recent commit 5 months ago
Location Based Restaurants Recommendation System ⭐ 23
Big Data Management and Analysis Final Project
most recent commit 6 years ago
Sample Kafkasparkcassandra ⭐ 21
Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.
most recent commit 5 years ago
The 4 Most Depended On Kafka Apache Spark Open Source Projects
Oryx ⭐ 1,793
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
dependent packages 2total releases 14latest release November 25, 2018most recent commit 3 years ago
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit a year ago
The 7 Latest Releases In Kafka Apache Spark Open Source Projects
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit a year ago
Azure Event Hubs Spark ⭐ 225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
total releases 68latest release July 03, 2019most recent commit a year ago
Oryx ⭐ 1,793
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
dependent packages 2total releases 14latest release November 25, 2018most recent commit 3 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.