Awesome Open Source

Programming Languages

Search results for postgresql airflow

21 search results found

Udacity Data Engineering Projects ⭐ 1,335

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Airflow Tutorial ⭐ 669

Apache Airflow tutorial

Data Engineering Projects ⭐ 322

Personal Data Engineering Projects

Astro Sdk ⭐ 303

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Beyond Jupyter ⭐ 125

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Data Science Stack Cookiecutter ⭐ 120

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

Airflow Tutorial ⭐ 86

Use Airflow to move data from multiple MySQL databases to BigQuery

Data Engineering Nanodegree ⭐ 76

Projects done in the Data Engineering Nanodegree by Udacity.com

Airflow Spark ⭐ 64

Docker with Airflow and Spark standalone cluster

Udacity Data Engineering ⭐ 42

Udacity Data Engineering Nano Degree (DEND)

Open drug data pipelines curated by pharmacists.

Debussy_concert ⭐ 29

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

Data Engineering Nanodegree ⭐ 27

Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift, Data Lake with Spark and Data Pipeline with Airflow.

Data Engineer Nanodegree Projects Udacity ⭐ 27

Projects done in the Data Engineer Nanodegree Program by Udacity.com

Terraform Aws Airflow ⭐ 20

Terraform module for a PostgreSQL-backed Apache Airflow instance

Spotify Api ⭐ 19

Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped

Karpov_courses ⭐ 16

🐳 Проектная деятельность. Здесь хранятся лекции, практические задания и проекты с karpov_courses. Ссылка: https://karpov.courses/

Airflowetl ⭐ 16

Blog post on ETL pipelines with Airflow

Airflowdatapipeline ⭐ 15

Example of an ETL Pipeline using Airflow

Testbed of AI Systems Quality Management

Marxan Cloud ⭐ 12

Monorepo for the Marxan Cloud platform

A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.

Airflow Essentials ⭐ 9

Materials for Airflow training

De Devtools ⭐ 8

Data Engineering Development Tools Installation and Configuration

This set of code and instructions has the porpouse to instanciate a compiled environment with set of docker images like airflow webserver, airflow scheduler, postgresql, pyspark, Data Pipeline consuming data from weather api , processing with pyspark and storing in postgresql

Airflow Local ⭐ 8

An Ubuntu Vagrant Virtual Machine (VM) with Airflow, a data workflow management system from Airbnb

This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/data/blob/main/A it's a zipped file with some .csvs inside that we will apply transformations.

Dockerized_data_science_playground ⭐ 6

Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a microservices-oriented architecture

Kubernetes Airflow ⭐ 6

Setup Apache Airflow on Kubernetes

Big Data Cluster ⭐ 6

The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Postgres, Cassandra, Hue, Zeppelin, Kadmin, Kafka Control Center and pgAdmin. This cluster is solely intended for usage in a development environment. Do not use it to run any production workloads.

ETL repository for DoIT work

Airflow Tutorial ⭐ 5

Udacity Data Engineering Nanodegree ⭐ 5

This is a repository to hold the files and notebooks produced throughout my Udacity's Nanodegree Data Engineering program.

Global Data Pipeline ⭐ 5

Code Repository for my 3rd Data Project.

Airflow Compose ⭐ 5

Data_infra_repo ⭐ 5

Collections of POC/dev data infrastructure. | #SE

Udacity Data Engineering Projects ⭐ 5

My solutions for the Udacity Data Engineering Nanodegree

Data Pipelines ⭐ 5

Data engineering monorepo with Airflow, dbt and postgres

Docker Compose Airflow ⭐ 5

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

Airflow Dcos ⭐ 5

Apache Airflow running on Mesosphere's Data Center Operating System (DC/OS)

Related Searches

Database Postgresql (5,322)

Javascript Postgresql (4,454)

Docker Postgresql (3,367)

Python Postgresql (2,800)

Typescript Postgresql (2,539)

Postgresql Sql (2,391)

Java Postgresql (2,173)

Reactjs Postgresql (2,110)

Django Postgresql (1,839)

Golang Postgresql (1,800)

1-21 of 21 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.