The Top 23 Python Orchestration Open Source Projects

Open source projects categorized as Python Orchestration

Categories > Virtualization > Orchestration

Categories > Programming Languages > Python

Airflow ⭐ 34,468

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169most recent commit 18 hours ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453most recent commit 3 months ago

Prefect ⭐ 14,603

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

dependent packages 152total releases 249most recent commit 3 days ago

Dify ⭐ 14,176

An Open-Source Assistants API and GPTs alternative. Dify.AI is an LLM application development platform. It integrates the concepts of Backend as a Service and LLMOps, covering the core tech stack required for building generative AI-native applications, including a built-in RAG engine.

total releases 8most recent commit 3 months ago

Dagster ⭐ 9,467

An orchestration platform for the development, production, and observation of data assets.

dependent packages 133total releases 585most recent commit 3 months ago

Mage Ai ⭐ 6,324

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

total releases 314most recent commit 3 months ago

Faraday ⭐ 4,422

Open Source Vulnerability Management Platform

dependent packages 1total releases 37most recent commit 3 months ago

Taipy ⭐ 4,311

Turns Data and AI algorithms into production-ready web applications in no time.

total releases 26most recent commit 3 months ago

Pipelines ⭐ 3,368

Machine Learning Pipelines for Kubeflow

dependent packages 77total releases 129most recent commit 3 months ago

Kapitan ⭐ 1,742

Generic templated configuration management for Kubernetes, Terraform and other things

dependent packages 1total releases 107most recent commit 21 days ago

Cloudstack ⭐ 1,611

Apache CloudStack is an opensource Infrastructure as a Service (IaaS) cloud computing platform

most recent commit 3 months ago

Hamilton ⭐ 1,272

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

dependent packages 2total releases 116most recent commit a month ago

Walkoff ⭐ 1,114

A flexible, easy to use, automation framework allowing users to integrate their capabilities and devices to cut through the repetitive, tedious tasks slowing them down. #nsacyber

most recent commit a year ago

Dstack ⭐ 913

dstack is an open-source toolkit for running GPU workloads on any cloud. It works seamlessly with any cloud GPU providers. Discord: https://discord.gg/u8SmfwPpMd

dependent packages 1total releases 12most recent commit 3 months ago

Flintrock ⭐ 627

A command-line tool for launching Apache Spark clusters.

total releases 14most recent commit 5 months ago

Covalent ⭐ 608

Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.

dependent packages 2total releases 118most recent commit 3 months ago

Kale ⭐ 517

Kubeflow’s superfood for Data Scientists

dependent packages 2total releases 7most recent commit 2 years ago

Aqueduct ⭐ 482

Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.

dependent packages 2total releases 48most recent commit a year ago

Lain ⭐ 452

LAIN's main repo

most recent commit 5 years ago

Odin ⭐ 448

A programmable, observable and distributed job orchestration system.

total releases 14most recent commit a year ago

Iwf ⭐ 428

iWF is an API orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes

total releases 24most recent commit 4 months ago

Heat ⭐ 383

OpenStack Orchestration (Heat). Mirror of code maintained at opendev.org.

most recent commit 3 months ago

Rackhd ⭐ 367

RackHD™ provides hardware management and orchestration services

dependent packages 2total releases 1most recent commit 4 years ago

The 10 Most Depended On Python Orchestration Open Source Projects

Airflow ⭐ 34,468

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169latest release November 27, 2023most recent commit 18 hours ago

Prefect ⭐ 14,603

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

dependent packages 152total releases 249latest release December 08, 2023most recent commit 3 days ago

Dagster ⭐ 9,467

An orchestration platform for the development, production, and observation of data assets.

dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months ago

Pipelines ⭐ 3,368

Machine Learning Pipelines for Kubeflow

dependent packages 77total releases 129latest release October 27, 2023most recent commit 3 months ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 3 months ago

Paco ⭐ 32

Paco: Prescribed automation for cloud orchestration

dependent packages 15total releases 824latest release December 01, 2023most recent commit 8 months ago

Orca ⭐ 45

Python library for task orchestration

dependent packages 11total releases 12latest release October 11, 2022most recent commit 2 years ago

Cloudaux ⭐ 70

Cloud Auxiliary is a python wrapper and orchestration module for interacting with cloud providers

dependent packages 4total releases 88latest release August 11, 2021most recent commit 3 years ago

Inmanta Core ⭐ 25

Inmanta is an automation and orchestration tool

dependent packages 4total releases 34latest release October 13, 2023most recent commit 3 months ago

Runcommands ⭐ 10

Simple command/task runner that uses Python's standard library argparse under the hood

dependent packages 3total releases 67latest release December 02, 2022most recent commit a year ago

The 10 Latest Releases In Python Orchestration Open Source Projects

Prefect ⭐ 14,603

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

dependent packages 152total releases 249latest release December 08, 2023most recent commit 3 days ago

Dagster ⭐ 9,467

An orchestration platform for the development, production, and observation of data assets.

dependent packages 133total releases 585latest release December 07, 2023most recent commit 3 months ago

Mage Ai ⭐ 6,324

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

total releases 314latest release December 06, 2023most recent commit 3 months ago

Hamilton ⭐ 1,272

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

dependent packages 2total releases 116latest release December 05, 2023most recent commit a month ago

Paco ⭐ 32

Paco: Prescribed automation for cloud orchestration

dependent packages 15total releases 824latest release December 01, 2023most recent commit 8 months ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 3 months ago

Covalent ⭐ 608

Pythonic tool for running machine-learning/high performance/quantum-computing workflows in heterogeneous environments.

dependent packages 2total releases 118latest release December 01, 2023most recent commit 3 months ago

Neo Cli ⭐ 8

Agnostic Orchestration Tools for Openstack

total releases 30latest release November 30, 2023most recent commit 5 months ago

Pureml ⭐ 174

Developer platform for production ML.

dependent packages 1total releases 29latest release November 27, 2023most recent commit a year ago

Airflow ⭐ 34,468

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169latest release November 27, 2023most recent commit 18 hours ago

Popular Virtualization Categories