Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Streaming Open Source Projects

Open source projects categorized as Spark Streaming
Categories > Networking > Streaming
Flink Learning ⭐ 13,198
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》
most recent commit 25 days ago
Coolplayspark ⭐ 3,333
酷玩 Spark: Spark 源代码解析、Spark 类库等
most recent commit 10 months ago
Scio ⭐ 2,436
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 34total releases 82most recent commit 2 days ago
Spark ⭐ 1,878
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 16total releases 20most recent commit a month agonuget Microsoft.Spark} Downloads
Lakesoul ⭐ 1,278
LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.
total releases 2most recent commit a day ago
Killrweather ⭐ 1,174
KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.
most recent commit 6 years ago
Utils4s ⭐ 1,033
scala、spark使用过程中，各种测试用例以及相关资料整理
most recent commit 4 years ago
Mobius ⭐ 933
C# and F# language binding and extensions to Apache Spark
total releases 22most recent commit 4 months ago
Spark Redis ⭐ 885
A connector for Spark that allows reading and writing to/from Redis cluster
dependent packages 1total releases 10most recent commit 5 months ago
Streaming Readings ⭐ 640
Streaming System 相关的论文读物
most recent commit a year ago
Reference Apps ⭐ 615
Spark reference applications
most recent commit 6 years ago
Streaming Benchmarks ⭐ 560
Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...
most recent commit a year ago
Sparta ⭐ 521
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 3 years ago
Streamdm ⭐ 456
Stream Data Mining Library for Spark Streaming
most recent commit 2 years ago
Spark Scala Examples ⭐ 443
This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language
most recent commit 3 months ago
Spark Solr ⭐ 426
Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
dependent packages 2total releases 100most recent commit a year ago
Learningpyspark ⭐ 409
Code base for the Learning PySpark book (in preparation)
most recent commit 4 years ago
Sylph ⭐ 396
Stream computing platform for bigdata
dependent packages 6total releases 1most recent commit a year ago
Spark Training ⭐ 365
Apache Spark training material
most recent commit 7 years ago
Bahir ⭐ 325
Mirror of Apache Bahir
dependent packages 5total releases 1most recent commit 20 days ago
Cloudflow ⭐ 323
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
dependent packages 7total releases 604most recent commit 19 days ago
Decision ⭐ 311
Powered by Spark Streaming & Siddhi
dependent packages 3total releases 13most recent commit 3 years ago
Data Accelerator ⭐ 282
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
dependent packages 5total releases 26most recent commit 5 days agonpm datax-common} Downloads
The 10 Most Depended On Spark Streaming Open Source Projects
Scio ⭐ 2,436
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 34total releases 82latest release March 30, 2020most recent commit 2 days ago
Spark ⭐ 1,878
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 16total releases 20latest release June 01, 2022most recent commit a month agonuget Microsoft.Spark} Downloads
Cloudflow ⭐ 323
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
dependent packages 7total releases 604latest release October 03, 2022most recent commit 19 days ago
Sylph ⭐ 396
Stream computing platform for bigdata
dependent packages 6total releases 1latest release July 03, 2019most recent commit a year ago
Bahir ⭐ 325
Mirror of Apache Bahir
dependent packages 5total releases 1latest release September 13, 2019most recent commit 20 days ago
Decision ⭐ 311
Powered by Spark Streaming & Siddhi
dependent packages 3total releases 13latest release September 16, 2015most recent commit 3 years ago
Spark Solr ⭐ 426
Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
dependent packages 2total releases 100latest release December 16, 2021most recent commit a year ago
Azure Event Hubs ⭐ 277
☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs
dependent packages 2total releases 2latest release March 02, 2016most recent commit 2 months agonpm tim-azure-event-hubs} Downloads
Spark Redis ⭐ 885
A connector for Spark that allows reading and writing to/from Redis cluster
dependent packages 1total releases 10latest release March 09, 2020most recent commit 5 months ago
The 10 Latest Releases In Spark Streaming Open Source Projects
Cloudflow ⭐ 323
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
dependent packages 7total releases 604latest release October 03, 2022most recent commit 19 days ago
Pulsar Spark ⭐ 96
When Apache Pulsar meets Apache Spark
total releases 3latest release June 10, 2022most recent commit 2 months ago
Spark ⭐ 1,878
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 16total releases 20latest release June 01, 2022most recent commit a month agonuget Microsoft.Spark} Downloads
Spark Solr ⭐ 426
Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
dependent packages 2total releases 100latest release December 16, 2021most recent commit a year ago
Hyperdrive ⭐ 40
Extensible streaming ingestion pipeline on top of Apache Spark
dependent packages 1total releases 8latest release November 20, 2020most recent commit 25 days ago
Kinesis Sql ⭐ 135
Kinesis Connector for Structured Streaming
total releases 7latest release October 01, 2020most recent commit 6 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Classification
Scraper
Transaction
Data Science
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.