Awesome Open Source

Programming Languages

Search results for database data engineering

data-engineering x

25 search results found

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Risingwave ⭐ 5,799

The distributed streaming database. Engineered to offer the simplest and most cost-efficient way for stream processing and management.

Data Diff ⭐ 2,707

Compare tables within or across databases

Data Engineering Wiki ⭐ 934

The best place to learn data engineering. Built and maintained by the data engineering community.

Data Engineering Book ⭐ 744

Accumulated knowledge and experience in the field of Data Engineering

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Versatile Data Kit ⭐ 389

One framework to develop, deploy and operate data workflows with Python and SQL.

Data Engineering With Python ⭐ 302

Data Engineering with Python, published by Packt

Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!

Morph Kgc ⭐ 151

Powerful RDF Knowledge Graph Generation with RML Mappings

Datachecks ⭐ 117

Open Source Data Quality Monitoring.

Dataengineeringpilipinas ⭐ 80

Data Engineering Pilipinas is a community for data engineers, data analysts, data scientists, developers, AI / ML engineers, and users of closed and open source data tools and methods / techniques in the Philippines. Data Engineering Pilipinas is a PyData group.

Apachespark ⭐ 59

This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.

A Python API for Dolt

De 100 Days ⭐ 22

data engineering 100 days 🤖 🧲 🦾 | #DE

Etl_manager ⭐ 21

A python package to create a database on the platform using our moj data warehousing framework

Big Data Engineering Indonesia ⭐ 18

A curated list of big data engineering tools, resources and communities.

Airflowetl ⭐ 16

Blog post on ETL pipelines with Airflow

Data Engineering Salaries ⭐ 16

A Streamlit app to explore data engineering salary data.

Azure Certification Dp 200 ⭐ 16

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

Sheetwork ⭐ 14

A handy package to load Google Sheets to your database right from the CLI and with easy configuration via YAML files.

Akka Lift Ml ⭐ 12

akka http service for serving spark machine learning models

Data Brewery ⭐ 12

Data Brewery is an ETL (Extract-Transform-Load) program that connect to many data sources (cloud services, databases, ...) and manage data warehouse workflow.

Data Pipeline With Dbt Using Airflow On Gcp ⭐ 10

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

Data Engineering ⭐ 9

This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Programing language incorporating MySQL, MongoDB and Docker

Awesome Edge ⭐ 8

A qualitative compilation of production-ready edge computing projects with a focus on Edge-2-Cloud Data Engineering

Common_datasets ⭐ 7

Common-datasets is a GitHub repository dedicated to providing a wide collection of common datasets for practicing and learning data science and machine learning.

Artificial Intelligence Research And Development Projects ⭐ 7

The field of Artificial Intelligence (AI) is a frontier of computer science that focuses on creating systems capable of performing tasks that would typically require human intelligence. This encompasses a wide range of capabilities such as visual perception, speech recognition, decision-making, and language translation.

Babbling.fish ⭐ 6

My personal blog about Data Engineering. Powered by Gatsby.

Dados Artigo Sbse 2023 ⭐ 5

Esse repositório reúne os dados utilizados para o desenvolvimento das simulações, bem os resultados obtidos, expostos no artigo "Uma Avaliação em Série-Temporal Quase-Estática da Capacidade de Hospedagem de Geração FV em Redes de Distribuição", submetido ao SBSE 2023.

Data_infra_repo ⭐ 5

Collections of POC/dev data infrastructure. | #SE

Data Readings ⭐ 5

Reading List in Data Systems

Related Searches

Command Line Database (33,932)

Python Database (10,521)

Javascript Database (9,210)

Database Mysql (6,245)

Php Database (5,990)

Java Database (5,934)

Database Sql (5,557)

Database Postgresql (5,359)

Docker Database (3,147)

Golang Database (2,926)

1-25 of 25 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.