Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Dataops Open Source Projects

Open source projects categorized as Dataops
Categories > Dataops
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249most recent commit 22 days agopypi prefect} Downloads
Cleanlab ⭐ 8,182
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
dependent packages 8total releases 24most recent commit 11 days agopypi cleanlab} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51most recent commit 17 days ago
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266most recent commit 3 months agopypi flyteidl} Downloads
Taipy ⭐ 4,311
Turns Data and AI algorithms into production-ready web applications in no time.
total releases 26most recent commit 3 months ago
Console ⭐ 3,583
Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.
dependent packages 1total releases 111most recent commit 15 days ago
Lance ⭐ 3,003
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
dependent packages 11total releases 108most recent commit 3 months agopypi pylance} Downloads
Whylogs ⭐ 2,533
An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
total releases 20most recent commit 10 days ago
Fast Data Dev ⭐ 1,972
Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
most recent commit 18 days ago
Elementary ⭐ 1,721
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
dependent packages 1total releases 68most recent commit 9 days agopypi elementary-data} Downloads
Sreworks ⭐ 1,562
Cloud Native DataOps & AIOps Platform | 云原生数智运维平台
dependent packages 2total releases 1most recent commit 6 months agonpm @sreworks/framework} Downloads
Marquez ⭐ 1,538
Collect, aggregate, and visualize a data ecosystem's metadata
total releases 36most recent commit 3 months ago
Meltano ⭐ 1,460
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
dependent packages 1total releases 263most recent commit 3 months agopypi meltano} Downloads
Stream Reactor ⭐ 960
A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.
dependent packages 1total releases 1most recent commit 3 months ago
Sqlmesh ⭐ 931
SQLMesh is a data transformation framework that brings the benefits of DevOps to data teams. It enables data scientists, analysts, and engineers to efficiently run and deploy data transformations written in SQL or Python.
dependent packages 1total releases 254most recent commit 3 months agopypi sqlmesh} Downloads
Tis ⭐ 833
Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
most recent commit 3 months ago
Optimus ⭐ 707
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
dependent packages 3total releases 120most recent commit 9 months ago
Active_workflow ⭐ 675
Polyglot workflows without leaving the comfort of your technology stack.
most recent commit a year ago
Tenzir ⭐ 608
Open source security data pipelines.
dependent packages 3total releases 43most recent commit 7 days agopypi pyvast} Downloads
Modern Data Warehouse Dataops ⭐ 521
DataOps for the Modern Data Warehouse on Microsoft Azure. https://aka.ms/mdw-dataops.
most recent commit 3 months ago
Traceml ⭐ 490
Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
dependent packages 12total releases 10most recent commit 2 months agopypi pandas-summary} Downloads
Awesome Data Catalogs ⭐ 441
📙 Awesome Data Catalogs and Observability Platforms.
most recent commit 7 months ago
Awesome Data Annotation ⭐ 398
A list of tools for annotating data, managing annotations, etc.
most recent commit 2 years ago
The 10 Most Depended On Dataops Open Source Projects
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 22 days agopypi prefect} Downloads
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266latest release December 06, 2023most recent commit 3 months agopypi flyteidl} Downloads
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181latest release November 28, 2023most recent commit 3 months agopypi vdk-core} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51latest release November 24, 2023most recent commit 17 days ago
Traceml ⭐ 490
Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
dependent packages 12total releases 10latest release November 25, 2021most recent commit 2 months agopypi pandas-summary} Downloads
Cleanlab ⭐ 8,182
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
dependent packages 8total releases 24latest release September 11, 2023most recent commit 11 days agopypi cleanlab} Downloads
Frontier ⭐ 219
Frontier is a role-based cloud-native user management, access and authorization server for your applications and API endpoints.
dependent packages 3total releases 80latest release December 22, 2023most recent commit 23 days ago
Tenzir ⭐ 608
Open source security data pipelines.
dependent packages 3total releases 43latest release October 14, 2022most recent commit 7 days agopypi pyvast} Downloads
The 10 Latest Releases In Dataops Open Source Projects
Frontier ⭐ 219
Frontier is a role-based cloud-native user management, access and authorization server for your applications and API endpoints.
dependent packages 3total releases 80latest release December 22, 2023most recent commit 23 days ago
Prefect ⭐ 14,339
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
dependent packages 152total releases 249latest release December 08, 2023most recent commit 22 days agopypi prefect} Downloads
Datachecks ⭐ 117
Open Source Data Quality Monitoring.
total releases 14latest release December 07, 2023most recent commit 3 months ago
Flyte ⭐ 4,380
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
dependent packages 35total releases 266latest release December 06, 2023most recent commit 3 months agopypi flyteidl} Downloads
Versatile Data Kit ⭐ 389
One framework to develop, deploy and operate data workflows with Python and SQL.
dependent packages 25total releases 181latest release November 28, 2023most recent commit 3 months agopypi vdk-core} Downloads
Benthos ⭐ 7,407
Fancy stream processing made operationally mundane
dependent packages 12total releases 51latest release November 24, 2023most recent commit 17 days ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.