Awesome Open Source
Awesome Open Source
Combined Topics
pipelines x
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210

The Top 43 Pipelines Open Source Projects

Categories > Data Processing > Pipelines
Concourse ⭐ 5,580
Concourse is a container-based continuous thing-doer written in Go.
Polyaxon ⭐ 2,791
Machine Learning Platform for Kubernetes
Airbyte ⭐ 2,231
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Transmogrifai ⭐ 2,002
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Zenml ⭐ 1,089
ZenML 🙏: MLOps framework to create reproducible ML pipelines for production machine learning.
Mlj.jl ⭐ 1,045
A Julia machine learning framework
Argo Events ⭐ 920
Event-driven workflow automation framework
Elyra ⭐ 876
Elyra extends JupyterLab Notebooks with an AI centric approach.
Orchest ⭐ 718
A new kind of IDE for Data Science.
Rain ⭐ 647
Framework for large distributed pipelines
Go Streams ⭐ 623
A lightweight stream processing library for Go
Glci ⭐ 489
🦊 Test your Gitlab CI Pipelines changes locally using Docker.
Onepanel ⭐ 439
The open and extensible integrated development environment (IDE) for computer vision with built-in modules for model building, automated labeling, data processing, model training, hyperparameter tuning and workflow orchestration.
Azure Devops Cli Extension ⭐ 426
Azure DevOps Extension for Azure CLI
Zerocopy ⭐ 389
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
Pipelines ⭐ 355
An experimental programming language for data flow
Gitlab Monitor ⭐ 348
A web-based monitor dashboard for GitLab CI
Drone Cli ⭐ 311
Command Line Tools for Drone CI
Opus ⭐ 302
A framework for pluggable business logic components
Smooks ⭐ 296
Extensible Java framework for building XML and non-XML fragment-based applications
Triggers ⭐ 286
Event triggering with Tekton!
Psi ⭐ 264
Platform for Situated Intelligence
Mkdkr ⭐ 229
Make + Docker + Shell = CI Pipeline
Hagar ⭐ 216
Fast, flexible, and version-tolerant serializer for .NET
Hydro Serving ⭐ 215
MLOps Platform
Sparktorch ⭐ 197
Train and run Pytorch models on Apache Spark.
Logrange ⭐ 183
High performance data aggregating storage
Pipelinec ⭐ 136
A C-like hardware description language (HDL) adding HLS(high level synthesis)-like automatic pipelining as a language construct/compiler feature.
Fluentmediator ⭐ 130
🔀 FluentMediator is an unobtrusive library that allows developers to build custom pipelines for Commands, Queries and Events.
Delivery Pipeline Plugin ⭐ 124
Jenkins plugin for pipeline visualisation, perfect for Continuous Delivery
Shovill ⭐ 118
⚡♠️ Assemble bacterial isolate genomes from Illumina paired-end reads
Incubator Hop ⭐ 98
Hop Orchestration Platform
Mlr3pipelines ⭐ 96
Dataflow Programming for Machine Learning in R
Aktion ⭐ 95
Translates GitHub Actions into Tekton and Knative Objects
Ck Tensorflow ⭐ 90
Collective Knowledge components for TensorFlow (code, data sets, models, packages, workflows):
Tdp ⭐ 68
The Darkest Pipeline - Multithreaded pipelines for modern C++
Variable Injector ⭐ 63
Continuous Integration Tool for Swift Projects
Pipelines ⭐ 59
Pipelines - Run Bitbucket Pipelines Wherever They Dock
Kubernetes Cicd ⭐ 54
Demonstration of a Kubernetes-centric CI/CD workflow
Mlprimitives ⭐ 47
Primitives for machine learning and data science.
Heroku Pipelines ⭐ 29
this code is now in https://github.com/heroku/cli
Iceci ⭐ 29
IceCI is a continuous integration system designed for Kubernetes from the ground up.
Sign Language Recogntion ⭐ 24
Cross platform sign language translation with mediapipe
1-43 of 43 projects
Advertising 📦 10
All Projects
Application Programming Interfaces 📦 124
Applications 📦 192
Artificial Intelligence 📦 78
Blockchain 📦 73
Build Tools 📦 113
Cloud Computing 📦 80
Code Quality 📦 28
Collaboration 📦 32
Command Line Interface 📦 49
Community 📦 83
Companies 📦 60
Compilers 📦 63
Computer Science 📦 80
Configuration Management 📦 42
Content Management 📦 175
Control Flow 📦 213
Data Formats 📦 78
Data Processing 📦 276
Data Storage 📦 135
Economics 📦 64
Frameworks 📦 215
Games 📦 129
Graphics 📦 110
Hardware 📦 152
Integrated Development Environments 📦 49
Learning Resources 📦 166
Legal 📦 29
Libraries 📦 129
Lists Of Projects 📦 22
Machine Learning 📦 347
Mapping 📦 64
Marketing 📦 15
Mathematics 📦 55
Media 📦 239
Messaging 📦 98
Networking 📦 315
Operating Systems 📦 89
Operations 📦 121
Package Managers 📦 55
Programming Languages 📦 245
Runtime Environments 📦 100
Science 📦 42
Security 📦 396
Social Media 📦 27
Software Architecture 📦 72
Software Development 📦 72
Software Performance 📦 58
Software Quality 📦 133
Text Editors 📦 49
Text Processing 📦 136
User Interface 📦 330
User Interface Components 📦 514
Version Control 📦 30
Virtualization 📦 71
Web Browsers 📦 42
Web Servers 📦 26
Web User Interface 📦 210