Awesome Open Source

Programming Languages

The Top 4 Python Spark Apache Airflow Open Source Projects

Open source projects categorized as Python Spark Apache Airflow

Categories > Apache Airflow

Categories > Programming Languages > Python

Categories > Data Processing > Spark

Goodreads_etl_pipeline ⭐ 593

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

most recent commit 4 years ago

PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows

most recent commit 6 months ago

Spark Movies Etl ⭐ 21

Spark data pipeline that ingests and transforms movie ratings data.

most recent commit 9 months ago

Covid 19 Data Engineering Pipeline ⭐ 19

A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.

most recent commit 6 months ago

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.