Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airbyte | 12,918 | 11 | 9 months ago | 311 | December 08, 2023 | 5,111 | other | Python | ||
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | ||||||||||
Risingwave | 6,701 | 3 months ago | 14 | December 07, 2023 | 1,010 | apache-2.0 | Rust | |||
Continuous SQL for event streams, database CDC, and time series. Perform streaming analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch processing. PostgreSQL compatible. | ||||||||||
Data Diff | 2,707 | 1 | 9 months ago | 69 | November 30, 2023 | 55 | mit | Python | ||
Compare tables within or across databases | ||||||||||
Data Engineering Wiki | 934 | 10 months ago | 6 | cc0-1.0 | CSS | |||||
The best place to learn data engineering. Built and maintained by the data engineering community. | ||||||||||
Data Engineering Book | 744 | 2 years ago | 2 | |||||||
Accumulated knowledge and experience in the field of Data Engineering | ||||||||||
Neumai | 693 | 10 months ago | 7 | apache-2.0 | Python | |||||
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale. | ||||||||||
Versatile Data Kit | 389 | 25 | 9 months ago | 181 | November 28, 2023 | 220 | apache-2.0 | Python | ||
One framework to develop, deploy and operate data workflows with Python and SQL. | ||||||||||
Data Engineering With Python | 302 | 2 years ago | 1 | mit | Python | |||||
Data Engineering with Python, published by Packt | ||||||||||
Yuniql | 292 | 1 | 7 | 2 years ago | 25 | May 25, 2022 | 65 | apache-2.0 | C# | |
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released! | ||||||||||
Morph Kgc | 151 | 2 | 6 months ago | 35 | November 21, 2023 | 16 | apache-2.0 | Python | ||
Powerful RDF Knowledge Graph Generation with RML Mappings |