Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Udacity Data Engineering Projects | 1,335 | 2 years ago | 1 | other | Python | |||||
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development. | ||||||||||
Dlt | 1,069 | 3 | 3 months ago | 52 | April 18, 2023 | 84 | apache-2.0 | Python | ||
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️ | ||||||||||
Bigfunctions | 490 | 3 months ago | 26 | mit | Python | |||||
Supercharge BigQuery with BigFunctions | ||||||||||
Automate Dv | 456 | 21 days ago | 39 | apache-2.0 | ||||||
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs) | ||||||||||
Versatile Data Kit | 389 | 25 | 3 months ago | 181 | November 28, 2023 | 220 | apache-2.0 | Python | ||
One framework to develop, deploy and operate data workflows with Python and SQL. | ||||||||||
Data Engineering Projects | 322 | a year ago | 5 | Jupyter Notebook | ||||||
Personal Data Engineering Projects | ||||||||||
Yuniql | 292 | 1 | 7 | 2 years ago | 25 | May 25, 2022 | 65 | apache-2.0 | C# | |
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released! | ||||||||||
Dataplane | 171 | 4 months ago | 30 | October 12, 2023 | 35 | other | JavaScript | |||
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end. | ||||||||||
Titan | 152 | 3 months ago | apache-2.0 | Python | ||||||
Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse. | ||||||||||
Bulker | 92 | 3 months ago | 2 | mit | Go | |||||
Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL) |