Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Kafka Spark Streaming Open Source Projects

Open source projects categorized as Scala Kafka Spark Streaming
Categories > Data Processing > Spark Streaming
Movie_recommend ⭐ 1,441
基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统
most recent commit 5 years ago
Sparta ⭐ 526
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 4 years ago
Gimel ⭐ 230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
most recent commit a year ago
Azure Event Hubs Spark ⭐ 225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
total releases 68most recent commit a year ago
Spark Streaming With Kafka ⭐ 161
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
most recent commit 6 years ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Spark Kafka ⭐ 136
Low level integration of Spark and Kafka
most recent commit 6 years ago
Example Spark Kafka ⭐ 118
Apache Spark and Apache Kafka integration example
most recent commit 6 years ago
Recommendmoteur ⭐ 57
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
most recent commit 6 years ago
Fdp Modelserver ⭐ 45
An umbrella project for multiple implementations of model serving
most recent commit 7 years ago
Xxhadoop ⭐ 37
Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !
most recent commit 3 years ago
Real Time Stream Processing Engine ⭐ 37
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
most recent commit 8 years ago
Litemall Dw ⭐ 36
基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；
most recent commit 2 years ago
Wasp ⭐ 25
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
dependent packages 15total releases 25most recent commit 7 months ago
Recommendsystem ⭐ 24
电影推荐系统
most recent commit 4 years ago
Bandar Log ⭐ 20
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
most recent commit 3 years ago
Sparknlp Elasticsearch ⭐ 17
Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana
most recent commit 6 years ago
Java_spark ⭐ 16
Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql
most recent commit 4 years ago
Nyc_taxi_pipeline ⭐ 12
Design/Implement stream/batch architecture on NYC taxi data | #DE
most recent commit 3 years ago
Spark Example ⭐ 11
Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea
most recent commit 6 years ago
Confluent Platform Spark Streaming ⭐ 10
Working example of consuming Avro data from Kafka with Spark Streaming
most recent commit 8 years ago
Bigdatademo ⭐ 9
The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big data project relates to Hadoop ecosystem
most recent commit 5 years ago
Kafka Scala Api ⭐ 8
Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams
most recent commit 7 years ago
The 2 Latest Releases In Scala Kafka Spark Streaming Open Source Projects
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.