Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Delta Lake Open Source Projects

Open source projects categorized as Spark Delta Lake
Categories > Delta Lake
Doris ⭐ 11,243
Apache Doris is an easy-to-use, high performance and unified analytics database.
total releases 8most recent commit 10 days ago
Delta ⭐ 6,656
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
dependent packages 45total releases 24most recent commit 3 months ago
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33most recent commit 3 months agopypi delta-sharing} Downloads
Learningsparkv2 ⭐ 570
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
most recent commit 2 years ago
Connectors ⭐ 383
This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.
total releases 5most recent commit 9 months ago
Dbldatagen ⭐ 234
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
total releases 12most recent commit 4 months ago
Lakehouse Engine ⭐ 154
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
most recent commit 3 months ago
Smart Data Lake ⭐ 87
Smart Automation Tool for building modern Data Lakes and Data Pipelines
dependent packages 8total releases 26most recent commit 3 months ago
Delta Architecture ⭐ 66
Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
most recent commit a year ago
Apachespark ⭐ 59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
most recent commit 2 years ago
Edc Mod1 Exercise Igti ⭐ 42
Exercícios do módulo 1 - Bootcamp EDC - IGTI 2021
most recent commit a year ago
Databricks ⭐ 41
Databricks Platform - Architecture, Security, Automation and much more!!
most recent commit 5 months ago
Building Data Lakehouse ⭐ 32
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
most recent commit 5 months ago
Real Time Data Warehouse ⭐ 29
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
most recent commit 2 years ago
Delta Go ⭐ 26
Native Delta Lake Implementation in Go
most recent commit 5 months ago
Spark Structured Streaming Examples ⭐ 25
Spark structured streaming examples with using of version 3.4.0
most recent commit 10 months ago
Spark Movies Etl ⭐ 21
Spark data pipeline that ingests and transforms movie ratings data.
most recent commit 8 months ago
Olh ⭐ 19
Open source stack lakehouse
most recent commit a year ago
Amazon Emr With Delta Lake ⭐ 17
Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR
most recent commit 5 months ago
Workshop Data Lakehouse ⭐ 11
Repositório dedicado a Workshop de Data Lakehouse com Delta Lake
most recent commit 2 years ago
Lighthouse ⭐ 8
Shed light on your data layout in order to monitor the health of your Lakehouse tables and identify when data maintenance operations should be performed.
total releases 1most recent commit 9 months ago
Cdk Emrserverless With Delta Lake ⭐ 8
This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you could also launch an EMR notebook via cluster template to check the outcome from the EMR Serverless application.
dependent packages 2total releases 369most recent commit 3 months agonpm cdk-emrserverless-with-delta-lake} Downloads
Diane ⭐ 7
Hive helper functions for apache spark users
total releases 4most recent commit a year ago
The 4 Most Depended On Spark Delta Lake Open Source Projects
Smart Data Lake ⭐ 87
Smart Automation Tool for building modern Data Lakes and Data Pipelines
dependent packages 8total releases 26latest release October 25, 2023most recent commit 3 months ago
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months agopypi delta-sharing} Downloads
The 10 Latest Releases In Spark Delta Lake Open Source Projects
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months agopypi delta-sharing} Downloads
Smart Data Lake ⭐ 87
Smart Automation Tool for building modern Data Lakes and Data Pipelines
dependent packages 8total releases 26latest release October 25, 2023most recent commit 3 months ago
Doris ⭐ 11,243
Apache Doris is an easy-to-use, high performance and unified analytics database.
total releases 8latest release September 27, 2023most recent commit 10 days ago
Diane ⭐ 7
Hive helper functions for apache spark users
total releases 4latest release May 20, 2023most recent commit a year ago
Doris Sdk ⭐ 5
SDK for Apache Doris
total releases 1latest release May 10, 2023most recent commit 4 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.