Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 13 Pipeline Data Integration Open Source Projects

Open source projects categorized as Pipeline Data Integration
Categories > Data Integration
Categories > Data Processing > Pipeline
Airbyte ⭐ 12,918
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
dependent packages 11total releases 311most recent commit 3 months agopypi airbyte-cdk} Downloads
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585most recent commit 3 months agopypi dagster} Downloads
Mage Ai ⭐ 6,324
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
total releases 314most recent commit 3 months ago
Kestra ⭐ 5,257
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
dependent packages 4total releases 58most recent commit 3 months ago
Mara Pipelines ⭐ 2,053
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
dependent packages 1total releases 8most recent commit 4 months agopypi mara-pipelines} Downloads
Cuelake ⭐ 266
Use SQL to build ELT pipelines on a data lakehouse.
most recent commit 2 years ago
Dataplane ⭐ 171
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
total releases 30most recent commit 4 months ago
Metl ⭐ 154
mito ETL tool
most recent commit 3 years ago
Prism ⭐ 70
Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.
most recent commit 3 months ago
Drivers ⭐ 53
Low-code Python library enabling access to APIs, tools, data sources in seconds.
total releases 403most recent commit 3 months ago
Mara Etl Tools ⭐ 33
Utilities for creating ETL pipelines with mara
total releases 5most recent commit 2 years ago
Cogstack Nifi ⭐ 29
Building data processing pipelines for documents processing with NLP using Apache NiFi and related services
most recent commit 3 months ago
Barnard59 ⭐ 20
An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.
dependent packages 5total releases 16most recent commit 3 months agonpm barnard59} Downloads
The 5 Most Depended On Pipeline Data Integration Open Source Projects
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Barnard59 ⭐ 20
An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.
dependent packages 5total releases 16latest release June 08, 2022most recent commit 3 months agonpm barnard59} Downloads
Mara Pipelines ⭐ 2,053
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
dependent packages 1total releases 8latest release December 06, 2023most recent commit 4 months agopypi mara-pipelines} Downloads
The 9 Latest Releases In Pipeline Data Integration Open Source Projects
Dagster ⭐ 9,467
An orchestration platform for the development, production, and observation of data assets.
dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months agopypi dagster} Downloads
Mara Pipelines ⭐ 2,053
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
dependent packages 1total releases 8latest release December 06, 2023most recent commit 4 months agopypi mara-pipelines} Downloads
Drivers ⭐ 53
Low-code Python library enabling access to APIs, tools, data sources in seconds.
total releases 403latest release November 29, 2023most recent commit 3 months ago
Barnard59 ⭐ 20
An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.
dependent packages 5total releases 16latest release June 08, 2022most recent commit 3 months agonpm barnard59} Downloads
Mara Etl Tools ⭐ 33
Utilities for creating ETL pipelines with mara
total releases 5latest release June 11, 2020most recent commit 2 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.