Awesome Open Source

Programming Languages

Search results for docker data engineering

data-engineering x

33 search results found

Data Engineering Zoomcamp ⭐ 19,461

Free Data Engineering course!

Lakefs ⭐ 3,900

lakeFS - Data version control for your data lake | Git for data

Yet another redundant workflow engine

Everything Tech ⭐ 372

A collection of online resources to help you on your Tech journey.

Phidata ⭐ 220

Build AI Assistants using function calling

Data Science For Everyone ⭐ 160

Data Science boot camp aims to make the field of data science accessible and understandable to a wide range of individuals, regardless of their background or expertise.

Movalytics Data Warehouse ⭐ 116

Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow

De Zoomcamp Ui ⭐ 107

🎨 UI for the Free Data Engineering Zoomcamp 2023 Course provided by DataTalksClub

Introduction To Docker ⭐ 69

Getting started with Docker - An introduction to Docker with data science and engineering applications

Containerized distributed programming framework for Python

Towardsdataengineering ⭐ 52

This repo contains commands that data engineers use in day to day work.

Camelboilerplate ⭐ 42

A Spring Boot Camel boilerplate that aims to consume events from Apache Kafka, process it and send to a PostgreSQL database.

rtdl makes it easy to build and maintain a real-time data lake

Schedule ⭐ 25

Schedule for talks, workshops, etc. w/ links to past talk slides and videos.

Aws Glue Docker ⭐ 22

🐋 Docker image for AWS Glue Spark/Python

Apache Spark Docker ⭐ 21

Dockerizing an Apache Spark Standalone Cluster

Neon Workshop ⭐ 20

A Pachyderm deep learning tutorial for conference workshops

Spotify Api ⭐ 19

Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped

Airflow Docker ⭐ 19

This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and workflows.

Data Pipeline from the Global Historical Climatology Network DataSet

Data Engineering Mta Turnstile ⭐ 14

Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

Akka Lift Ml ⭐ 12

akka http service for serving spark machine learning models

Airflowjob ⭐ 11

Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE

A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.

Fake Data Pipeline ⭐ 10

Data Generators -> Kafka -> Spark Streaming -> PostgreSQL -> Grafana

Data Engineering ⭐ 9

This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Programing language incorporating MySQL, MongoDB and Docker

Fastapi Your Data ⭐ 8

Development of a modular and scalable backend template for Cloud data exposure using FastAPI, SQLAlchemy and Alembic

Docker Streamsets Kafka Minecraft ⭐ 7

Visualize Apache logs in Minecraft using Docker, Streamsets Data Collector, Spigot and Kafka .

Data Engineer Challenge ⭐ 7

Challenge Data Engineer

Dockerized_data_science_playground ⭐ 6

Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a microservices-oriented architecture

Flink Example ⭐ 6

Data Engineering Project With Hdfs And Kafka ⭐ 5

Data Engineering Project with Hadoop HDFS and Kafka

Data_infra_repo ⭐ 5

Collections of POC/dev data infrastructure. | #SE

Workspace ⭐ 5

This repository provides containerized applications and microservices for the Information Systems and Databases Course @ Instituto Superior Técnico

Analytics_data_where_house ⭐ 5

An analytics engineering sandbox focusing on real estates prices in Cook County, IL

Aiscalator ⭐ 5

Tools to streamline Jupyter Notebook Prototypes into robust Data Products

Related Searches

Shell Docker (20,660)

Docker Dockerfile (16,395)

Python Docker (16,341)

Javascript Docker (10,426)

Golang Docker (7,702)

Php Docker (6,192)

Java Docker (6,071)

Docker Nginx (5,238)

Typescript Docker (4,630)

Docker Postgresql (4,363)

1-33 of 33 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.