Awesome Open Source
Awesome Open Source
Combined Topics
pipelines x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 40 Pipelines Open Source Projects

Categories > Data Processing > Pipelines
Concourse ⭐ 5,403
Concourse is a container-based continuous thing-doer written in Go and Elm.
Polyaxon ⭐ 2,694
Machine Learning Platform for Kubernetes
Transmogrifai ⭐ 1,980
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Mlj.jl ⭐ 932
A Julia machine learning framework
Elyra ⭐ 765
Elyra extends JupyterLab Notebooks with an AI centric approach.
Argo Events ⭐ 732
Event-driven workflow automation framework
Rain ⭐ 642
Framework for large distributed pipelines
Orchest ⭐ 608
A new kind of IDE for Data Science.
Go Streams ⭐ 579
A lightweight stream processing library for Go
Airbyte ⭐ 531
Airbyte is an open-source data integration platform that helps you consolidate your data in your warehouses, lakes and databases.
Azure Devops Cli Extension ⭐ 407
Azure DevOps Extension for Azure CLI
Zenml ⭐ 378
ZenML: Bring Zen to your ML with reproducible pipelines
Zerocopy ⭐ 375
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
Core ⭐ 372
Production grade, end-to-end vision AI platform with fully integrated modules for model building, automated labeling, data processing, model training and hyperparameter tuning.
Pipelines ⭐ 351
An experimental programming language for data flow
Gitlab Monitor ⭐ 334
A web-based monitor dashboard for GitLab CI
Opus ⭐ 294
A framework for pluggable business logic components
Drone Cli ⭐ 292
Command Line Tools for Drone CI
Triggers ⭐ 258
Event triggering with Tekton!
Psi ⭐ 228
Platform for Situated Intelligence
Hagar ⭐ 216
Fast, flexible, and version-tolerant serializer for .NET
Mkdkr ⭐ 211
Make + Docker + Shell = CI Pipeline
Hydro Serving ⭐ 206
MLOps Platform
Sparktorch ⭐ 186
Train and run Pytorch models on Apache Spark.
Logrange ⭐ 183
High performance data aggregating storage
Delivery Pipeline Plugin ⭐ 120
Jenkins plugin for pipeline visualisation, perfect for Continuous Delivery
Fluentmediator ⭐ 115
🔀 FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
Shovill ⭐ 113
⚡♠️ Assemble bacterial isolate genomes from Illumina paired-end reads
Aktion ⭐ 91
Translates GitHub Actions into Tekton and Knative Objects
Ck Tensorflow ⭐ 90
Collective Knowledge components for TensorFlow (code, data sets, models, packages, workflows):
Mlr3pipelines ⭐ 82
Dataflow Programming for Machine Learning in R
Tdp ⭐ 67
The Darkest Pipeline - Multithreaded pipelines for modern C++
Variable Injector ⭐ 61
Continuous Integration Tool for Swift Projects
Incubator Hop ⭐ 61
Hop Orchestration Platform
Kubernetes Cicd ⭐ 54
Demonstration of a Kubernetes-centric CI/CD workflow
Pipelines ⭐ 51
Pipelines - Run Bitbucket Pipelines Wherever They Dock
Mlprimitives ⭐ 44
Primitives for machine learning and data science.
Heroku Pipelines ⭐ 29
this code is now in https://github.com/heroku/cli
Iceci ⭐ 29
IceCI is a continuous integration system designed for Kubernetes from the ground up.
Sign Language Recogntion ⭐ 22
Cross platform sign language translation with mediapipe
1-40 of 40 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210