Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 21 Data Engineering Dataops Open Source Projects

Open source projects categorized as Data Engineering Dataops
Categories > Data Processing > Data Engineering
Categories > Dataops
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249most recent commit a month agopypi prefect} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51most recent commit 20 days ago
Taipy ⭐ 4,311
Turns Data and AI algorithms into production-ready web applications in no time.
total releases 26most recent commit 3 months ago
Meltano ⭐ 1,460
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
dependent packages 1total releases 263most recent commit 3 months agopypi meltano} Downloads
Sqlmesh ⭐ 931
SQLMesh is a data transformation framework that brings the benefits of DevOps to data teams. It enables data scientists, analysts, and engineers to efficiently run and deploy data transformations written in SQL or Python.
dependent packages 1total releases 254most recent commit 3 months agopypi sqlmesh} Downloads
Active_workflow ⭐ 675
Polyglot workflows without leaving the comfort of your technology stack.
most recent commit a year ago
Awesome Data Catalogs ⭐ 441
📙 Awesome Data Catalogs and Observability Platforms.
most recent commit 7 months ago
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181most recent commit 3 months agopypi vdk-core} Downloads
Aws Ddk ⭐ 233
An open source development framework to help you build data workflows and modern data architecture on AWS.
total releases 22most recent commit 3 months ago
Titan ⭐ 152
Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API. Change Management tool for the Snowflake data warehouse.
most recent commit 3 months ago
Raptor ⭐ 136
Transform your pythonic research to an artifact that engineers can deploy easily.
total releases 22most recent commit 6 months ago
Datachecks ⭐ 117
Open Source Data Quality Monitoring.
total releases 14most recent commit 3 months ago
Awesome Dataops ⭐ 78
😎 A curated list of awesome DataOps tools
most recent commit 7 months ago
Cauldron ⭐ 77
Interactive computing for complex data processing, modeling and analysis in Python 3
total releases 66most recent commit 2 years ago
Beneath ⭐ 64
Beneath is a serverless real-time data platform ⚡️
total releases 38most recent commit 2 years ago
Data Engineering And Dataops ⭐ 34
Duke MIDS: Data Engineering and DataOps Course
most recent commit 10 months ago
Funsies ⭐ 25
funsies is a lightweight workflow engine 🔧
most recent commit 3 years ago
Stairlight ⭐ 25
A data lineage tool detects table dependencies from rendered SQL statements.
most recent commit 5 months ago
Grant Rs ⭐ 18
Manage Redshift/Postgres privileges in GitOps style written in Rust
most recent commit 8 months ago
Data Paths ⭐ 11
most recent commit a year ago
Awesome Dataops ⭐ 10
Awesome list of dataops products, open source and resources
most recent commit 2 years ago
The 5 Most Depended On Data Engineering Dataops Open Source Projects
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit a month agopypi prefect} Downloads
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181latest release November 28, 2023most recent commit 3 months agopypi vdk-core} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51latest release November 24, 2023most recent commit 20 days ago
The 10 Latest Releases In Data Engineering Dataops Open Source Projects
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit a month agopypi prefect} Downloads
Datachecks ⭐ 117
Open Source Data Quality Monitoring.
total releases 14latest release December 07, 2023most recent commit 3 months ago
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181latest release November 28, 2023most recent commit 3 months agopypi vdk-core} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51latest release November 24, 2023most recent commit 20 days ago
Taipy ⭐ 4,311
Turns Data and AI algorithms into production-ready web applications in no time.
total releases 26latest release October 27, 2023most recent commit 3 months ago
Raptor ⭐ 136
Transform your pythonic research to an artifact that engineers can deploy easily.
total releases 22latest release February 15, 2023most recent commit 6 months ago
Beneath ⭐ 64
Beneath is a serverless real-time data platform ⚡️
total releases 38latest release September 03, 2021most recent commit 2 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.