Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Delta Lake Open Source Projects

Open source projects categorized as Delta Lake
Categories > Delta Lake
Doris ⭐ 7,675
Apache Doris is an easy-to-use, high performance and unified analytics database.
most recent commit 13 hours ago
Trino ⭐ 7,533
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
dependent packages 9total releases 51most recent commit 13 hours ago
Delta ⭐ 5,819
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
dependent packages 12total releases 9most recent commit 16 hours agopypi delta-spark} Downloads
Starrocks ⭐ 4,245
StarRocks is a next-gen sub-second MPP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics and ad-hoc query.
most recent commit 13 hours ago
Roapi ⭐ 2,705
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
total releases 17most recent commit 7 days ago
Delta Rs ⭐ 978
A native Rust library for Delta Lake, with bindings into Python
dependent packages 6total releases 26most recent commit a day agopypi deltalake} Downloads
Learningsparkv2 ⭐ 570
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
most recent commit a year ago
Delta Sharing ⭐ 545
An open protocol for secure data sharing
dependent packages 2total releases 6most recent commit 2 days agopypi delta-sharing} Downloads
Connectors ⭐ 350
This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.
total releases 4most recent commit 8 days ago
Kafka Delta Ingest ⭐ 187
A highly efficient daemon for streaming data from Kafka into Delta Lake
most recent commit 23 days ago
Amazon Sagemaker Local Mode ⭐ 175
Amazon SageMaker Local Mode Examples
most recent commit 5 days ago
Mack ⭐ 133
Delta Lake helper methods in PySpark
most recent commit 10 days ago
Dbldatagen ⭐ 128
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
most recent commit 2 days ago
Smart Data Lake ⭐ 81
Smart Automation Tool for building modern Data Lakes and Data Pipelines
total releases 19most recent commit 8 days ago
Delta Architecture ⭐ 66
Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
most recent commit 2 months ago
Streamis ⭐ 64
Streaming application development and management system, based on Linkis and DSS, planning to provide the workflow-like graphical drag-and-drop development capability.
most recent commit 9 months ago
Apachespark ⭐ 59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
most recent commit 5 months ago
Edc Mod1 Exercise Igti ⭐ 42
Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021
most recent commit 6 days ago
Databricks ⭐ 35
Databricks Platform - Architecture, Security, Automation and much more!!
most recent commit 19 days ago
Deltalakereader ⭐ 34
Read Delta tables without any Spark
total releases 15most recent commit 6 months ago
101_upsert Delta ⭐ 30
This repository exemplifies a simple ELT process using delta to perform upsert and remove data files that aren't in the latest state of the transaction log for the table.
most recent commit a year ago
Pysparkcheatsheet ⭐ 30
PySpark Cheatsheet
most recent commit 2 months ago
Real Time Data Warehouse ⭐ 29
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
most recent commit a year ago
The 4 Most Depended On Delta Lake Open Source Projects
Trino ⭐ 7,533
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
dependent packages 9total releases 51latest release December 29, 2020most recent commit 13 hours ago
Delta Rs ⭐ 978
A native Rust library for Delta Lake, with bindings into Python
dependent packages 6total releases 26latest release June 23, 2022most recent commit a day agopypi deltalake} Downloads
Delta Sharing ⭐ 545
An open protocol for secure data sharing
dependent packages 2total releases 6latest release June 16, 2022most recent commit 2 days agopypi delta-sharing} Downloads
The 9 Latest Releases In Delta Lake Open Source Projects
Smart Data Lake ⭐ 81
Smart Automation Tool for building modern Data Lakes and Data Pipelines
total releases 19latest release September 16, 2022most recent commit 8 days ago
Delta Rs ⭐ 978
A native Rust library for Delta Lake, with bindings into Python
dependent packages 6total releases 26latest release June 23, 2022most recent commit a day agopypi deltalake} Downloads
Delta Sharing ⭐ 545
An open protocol for secure data sharing
dependent packages 2total releases 6latest release June 16, 2022most recent commit 2 days agopypi delta-sharing} Downloads
Roapi ⭐ 2,705
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
total releases 17latest release March 20, 2022most recent commit 7 days ago
Deltalakereader ⭐ 34
Read Delta tables without any Spark
total releases 15latest release March 10, 2022most recent commit 6 months ago
Trino ⭐ 7,533
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
dependent packages 9total releases 51latest release December 29, 2020most recent commit 13 hours ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.