Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Spark Kafka Open Source Projects

Open source projects categorized as Scala Spark Kafka
Bigdata Notes ⭐ 14,872
大数据入门指南 ⭐
most recent commit 3 months ago
Bigdataguide ⭐ 2,355
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
most recent commit 4 months ago
Szt Bigdata ⭐ 2,055
深圳地铁大数据客流分析系统🚇🚄🌟
most recent commit 3 months ago
Movie_recommend ⭐ 1,441
基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统
most recent commit 5 years ago
Killrweather ⭐ 1,174
KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.
most recent commit 7 years ago
Kafka Storm Starter ⭐ 729
[PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
most recent commit 2 years ago
Pkpmspark ⭐ 697
awesome 三维数据挖掘 数据分析 & 推荐
most recent commit 4 years ago
Freestyle ⭐ 615
A cohesive & pragmatic framework of FP centric Scala libraries
dependent packages 34total releases 19most recent commit 5 years ago
Sparta ⭐ 526
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 4 years ago
Every Single Day I Tldr ⭐ 311
A daily digest of the articles or videos I've found interesting, that I want to share with you.
most recent commit 3 months ago
Koober ⭐ 301
most recent commit 6 years ago
Sparkstreaming ⭐ 253
Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志
most recent commit 6 years ago
Kafka Exactly Once ⭐ 245
most recent commit 6 years ago
Gimel ⭐ 230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
most recent commit a year ago
Azure Event Hubs Spark ⭐ 225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
total releases 68most recent commit a year ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17most recent commit 8 months ago
Spark Kafka Writer ⭐ 177
Write your Spark data to Kafka seamlessly
total releases 2most recent commit 2 years ago
Spark Streaming With Kafka ⭐ 161
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
most recent commit 6 years ago
Aliyun Emapreduce Datasources ⭐ 157
Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.
dependent packages 3total releases 15most recent commit 2 years ago
Spark Structured Streaming Examples ⭐ 153
Spark Structured Streaming / Kafka / Cassandra / Elastic
most recent commit 6 years ago
Spark Kafka ⭐ 136
Low level integration of Spark and Kafka
most recent commit 6 years ago
Logvision ⭐ 136
分布式实时日志分析与入侵检测系统
most recent commit a year ago
Example Spark Kafka ⭐ 118
Apache Spark and Apache Kafka integration example
most recent commit 6 years ago
The 8 Most Depended On Scala Spark Kafka Open Source Projects
Freestyle ⭐ 615
A cohesive & pragmatic framework of FP centric Scala libraries
dependent packages 34total releases 19latest release June 07, 2018most recent commit 5 years ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17latest release October 06, 2020most recent commit 8 months ago
Aliyun Emapreduce Datasources ⭐ 157
Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.
dependent packages 3total releases 15latest release February 19, 2019most recent commit 2 years ago
Baryon ⭐ 12
Baryon is a library for building Spark Streaming applications that consume data from Kafka.
dependent packages 2total releases 1latest release July 04, 2016most recent commit 7 years ago
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit a year ago
Busfloatingdata ⭐ 59
Showcase for IoT Platform Blog
dependent packages 1total releases 1latest release September 25, 2016most recent commit 5 years ago
The 10 Latest Releases In Scala Spark Kafka Open Source Projects
Spark Sql Kafka Offset Committer ⭐ 15
Kafka offset committer for structured streaming query
total releases 6latest release December 15, 2020most recent commit 3 years ago
Hyperdrive ⭐ 41
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit a year ago
Abris ⭐ 215
Avro SerDe for Apache Spark structured APIs.
dependent packages 5total releases 17latest release October 06, 2020most recent commit 8 months ago
Azure Event Hubs Spark ⭐ 225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
total releases 68latest release July 03, 2019most recent commit a year ago
Spark Adhoc Kafka ⭐ 7
This is a datasource implementation for quick query in Kafka with Spark
total releases 3latest release June 26, 2019most recent commit 5 years ago
Aliyun Emapreduce Datasources ⭐ 157
Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.
dependent packages 3total releases 15latest release February 19, 2019most recent commit 2 years ago
Freestyle ⭐ 615
A cohesive & pragmatic framework of FP centric Scala libraries
dependent packages 34total releases 19latest release June 07, 2018most recent commit 5 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.