Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Airbyte | 12,918 | 11 | 3 months ago | 311 | December 08, 2023 | 5,111 | other | Python | ||
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. | ||||||||||
Pachyderm | 6,035 | 1 | 3 months ago | 613 | December 04, 2023 | 897 | apache-2.0 | Go | ||
Data-Centric Pipelines and Data Versioning | ||||||||||
Dataflowjavasdk | 853 | 249 | 14 | 3 years ago | 38 | June 26, 2018 | 54 | |||
Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. | ||||||||||
Chain.jl | 262 | 2 years ago | 16 | mit | Julia | |||||
A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality. | ||||||||||
Setl | 173 | 5 months ago | 4 | August 21, 2020 | 5 | apache-2.0 | Scala | |||
A simple Spark-powered ETL framework that just works 🍺 | ||||||||||
Dataplane | 171 | 4 months ago | 30 | October 12, 2023 | 35 | other | JavaScript | |||
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end. | ||||||||||
Pipeline | 169 | 3 years ago | 7 | mit | C | |||||
the `pipeline` shell command | ||||||||||
Datajoint Python | 158 | 12 | 26 | 4 months ago | 66 | September 21, 2022 | 143 | lgpl-2.1 | Python | |
Relational data pipelines for the science lab | ||||||||||
Jiro Nn | 113 | 7 months ago | 6 | July 04, 2023 | Rust | |||||
A Deep Learning and preprocessing framework in Rust with support for CPU and GPU. | ||||||||||
Data_algebra | 112 | 1 | 3 | 6 months ago | 91 | September 29, 2023 | 2 | bsd-3-clause | Python | |
Codd method-chained SQL generator and Pandas data processing in Python. |