Awesome Open Source

Programming Languages

The Top 23 Spark Flink Open Source Projects

Open source projects categorized as Spark Flink

Categories > Data Processing > Flink

Categories > Data Processing > Spark

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

most recent commit 4 months ago

Flink Learning ⭐ 13,801

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》

most recent commit 7 months ago

God Of Bigdata ⭐ 8,483

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.

most recent commit 9 months ago

Zeppelin ⭐ 6,259

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

dependent packages 31total releases 2most recent commit 18 days ago

npm zeppelin-vis} Downloads

Risingwave ⭐ 5,799

The distributed streaming database. Engineered to offer the simplest and most cost-efficient way for stream processing and management.

total releases 14most recent commit 3 months ago

Iceberg ⭐ 5,179

total releases 3most recent commit 3 months ago

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7most recent commit 3 months ago

Analytics Zoo ⭐ 2,592

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

dependent packages 3total releases 1most recent commit 4 months ago

pypi bigdl-orca-spark321} Downloads

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

most recent commit 4 months ago

Lakesoul ⭐ 2,248

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

dependent packages 1total releases 7most recent commit 3 months ago

Szt Bigdata ⭐ 2,055

深圳地铁大数据客流分析系统🚇🚄🌟

most recent commit 3 months ago

Quicksql ⭐ 1,939

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

most recent commit 2 years ago

Incubator Paimon ⭐ 1,647

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

dependent packages 25total releases 2most recent commit 3 months ago

Bigdata Interview ⭐ 1,397

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop

most recent commit 3 years ago

Bigdata Growth ⭐ 1,256

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

most recent commit 10 days ago

Taier ⭐ 1,220

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

total releases 2most recent commit 3 months ago

Coding Now ⭐ 925

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、

most recent commit 2 years ago

Hadoop_study ⭐ 817

定期更新Hadoop生态圈中常用大数据组件文档重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图印象笔记 Scala版本简单demo 常用工具类去敏后的train code 持续更新!!!)

most recent commit 2 years ago

Streaming Readings ⭐ 640

Streaming System 相关的论文读物

most recent commit 2 years ago

Wedatasphere ⭐ 624

WeDataSphere is a financial grade, one-stop big data platform suite.

most recent commit 3 months ago

Pythondatascience Collections ⭐ 615

最全数据分析资料汇总（含python、爬虫、数据库、大数据、tableau、统计学等）

most recent commit 3 years ago

Streaming Benchmarks ⭐ 560

Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...

most recent commit 2 years ago

Data Engineering Interview Questions ⭐ 554

More than 2000+ Data engineer interview questions.

most recent commit 7 months ago

The 10 Most Depended On Spark Flink Open Source Projects

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7latest release August 07, 2023most recent commit 3 months ago

Zeppelin ⭐ 6,259

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

dependent packages 31total releases 2latest release June 21, 2017most recent commit 18 days ago

npm zeppelin-vis} Downloads

Incubator Paimon ⭐ 1,647

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

dependent packages 25total releases 2latest release August 25, 2023most recent commit 3 months ago

Ammonium ⭐ 64

Impatient fork of Ammonite

dependent packages 22total releases 8latest release November 18, 2016most recent commit 6 years ago

A temporary home for LinkedIn's changes to Apache Iceberg (incubating)

dependent packages 13total releases 33latest release October 13, 2023most recent commit 4 months ago

Featran ⭐ 465

A Scala feature transformation library for data science and machine learning

dependent packages 11total releases 34latest release December 04, 2019most recent commit a year ago

Cloudflow ⭐ 323

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

dependent packages 11total releases 609latest release July 27, 2023most recent commit 9 months ago

Stream computing platform for bigdata

dependent packages 6total releases 1latest release July 03, 2019most recent commit 2 years ago

A type class for data of all sizes.

dependent packages 4total releases 1latest release January 07, 2017most recent commit 5 years ago

Analytics Zoo ⭐ 2,592

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

dependent packages 3total releases 1latest release July 29, 2022most recent commit 4 months ago

pypi bigdl-orca-spark321} Downloads

The 10 Latest Releases In Spark Flink Open Source Projects

Risingwave ⭐ 5,799

The distributed streaming database. Engineered to offer the simplest and most cost-efficient way for stream processing and management.

total releases 14latest release December 07, 2023most recent commit 3 months ago

Kamu Cli ⭐ 263

New generation decentralized data lake and a streaming data pipeline

total releases 1latest release November 16, 2023most recent commit 3 months ago

Pulsar Spark ⭐ 103

Spark Connector to read and write with Pulsar

dependent packages 2total releases 10latest release November 06, 2023most recent commit 5 months ago

A temporary home for LinkedIn's changes to Apache Iceberg (incubating)

dependent packages 13total releases 33latest release October 13, 2023most recent commit 4 months ago

Lakesoul ⭐ 2,248

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

dependent packages 1total releases 7latest release October 12, 2023most recent commit 3 months ago

Incubator Paimon ⭐ 1,647

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

dependent packages 25total releases 2latest release August 25, 2023most recent commit 3 months ago

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7latest release August 07, 2023most recent commit 3 months ago

Cloudflow ⭐ 323

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

dependent packages 11total releases 609latest release July 27, 2023most recent commit 9 months ago

Iceberg ⭐ 5,179

total releases 3latest release October 29, 2022most recent commit 3 months ago

Analytics Zoo ⭐ 2,592

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

dependent packages 3total releases 1latest release July 29, 2022most recent commit 4 months ago

pypi bigdl-orca-spark321} Downloads

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.