Awesome Open Source
Awesome Open Source
Combined Topics
docker x
pipeline x

The Top 690 Docker Pipeline Open Source Projects

Categories > Virtualization > Docker
Categories > Data Processing > Pipeline
Skaffold ⭐ 13,680
Easy and Repeatable Kubernetes Development
dependent packages 7total releases 107most recent commit 18 hours ago
Argo Cd ⭐ 11,921
Declarative continuous deployment for Kubernetes.
dependent packages 25total releases 402most recent commit 18 hours ago
Prefect ⭐ 11,196
The easiest way to coordinate your dataflow
dependent packages 70total releases 162most recent commit 18 hours agopypi prefect} Downloads
Pachyderm ⭐ 5,814
Data-Centric Pipelines and Data Versioning
dependent packages 1total releases 220most recent commit 18 hours ago
Deeplearningproject ⭐ 4,043
An in-depth machine learning tutorial introducing readers to a whole machine learning pipeline from scratch.
most recent commit 3 years ago
Orchest ⭐ 3,692
Build data pipelines, the easy way 🛠️
total releases 14most recent commit 2 days ago
Templates ⭐ 3,119
.NET project templates with batteries included, providing the minimum amount of code required to get you going faster.
dependent packages 1total releases 33most recent commit 23 days agonuget Boilerplate.Web.Mvc6} Downloads
Nextflow ⭐ 1,945
A DSL for data-driven computational pipelines
dependent packages 15total releases 212most recent commit a day ago
Elyra ⭐ 1,537
Elyra extends JupyterLab with an AI centric approach.
dependent packages 10total releases 89most recent commit 2 days agonpm @elyra/ui-components} Downloads
Lastbackend ⭐ 1,437
System for containerized apps management. From build to scaling.
most recent commit 3 years ago
Galaxy ⭐ 1,050
Data intensive science for everyone.
dependent packages 12total releases 13most recent commit 20 hours agopypi galaxy-util} Downloads
Datakit ⭐ 999
Connect processes into powerful data pipelines with a simple git-like filesystem interface
most recent commit a year ago
Mu ⭐ 935
A full-stack DevOps on AWS framework
total releases 60most recent commit 3 years ago
Ecs Refarch Continuous Deployment ⭐ 828
ECS Reference Architecture for creating a flexible and scalable deployment pipeline to Amazon ECS using AWS CodePipeline
most recent commit 2 months ago
Serving ⭐ 721
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 2 months agopypi paddle-serving-client} Downloads
Nexclipper ⭐ 550
Metrics Pipeline for interoperability and Enterprise Prometheus
most recent commit 2 years ago
Glci ⭐ 531
🦊 Test your Gitlab CI Pipelines changes locally using Docker.
total releases 13most recent commit a year ago
Docker Workflow Plugin ⭐ 472
Jenkins plugin which allows building, testing, and using Docker images from Jenkins Pipeline projects.
most recent commit 2 months ago
Data Pipelines With Apache Airflow ⭐ 441
Code for Data Pipelines with Apache Airflow
most recent commit 16 days ago
Container Service For Azure China ⭐ 404
Container Service for Azure China
most recent commit 5 days ago
Archlinux Docker ⭐ 398
Docker Base Image for Arch Linux (read-only mirror)
most recent commit 11 days ago
Docker Android Build Box ⭐ 393
An optimized docker image includes Android, Kotlin, Flutter sdk.
most recent commit 13 days ago
Smooks ⭐ 355
Extensible data integration Java framework for building XML and non-XML fragment-based applications
dependent packages 12total releases 20most recent commit 3 days ago
Hands On Devops ⭐ 292
A hands-on DevOps course covering the culture, methods and repeated practices of modern software development involving Packer, Vagrant, VirtualBox, Ansible, Kubernetes, K3s, MetalLB, Traefik, Docker-Compose, Docker, Taiga, GitLab, Drone CI, SonarQube, Selenium, InSpec, Alpine 3.10, Ubuntu-bionic, CentOS 7...
most recent commit a year ago
Katana Skipper ⭐ 288
Simple and flexible ML workflow engine
total releases 9most recent commit 2 months ago
Java Microservice ⭐ 287
A full microservice project using Spring and many others tools
most recent commit a year ago
Hydro Serving ⭐ 248
MLOps Platform
most recent commit a year ago
Mkdkr ⭐ 241
Make + Docker + Shell = CI Pipeline
most recent commit 2 years ago
Cookiecutter Fastapi ⭐ 239
Cookiecutter template for FastAPI projects using: Machine Learning, Poetry, Github Actions and Pytests
most recent commit 10 days ago
Funannotate ⭐ 227
Eukaryotic Genome Annotation Pipeline
total releases 12most recent commit 8 days ago
Jenkinsfiles ⭐ 201
Examples for jenkins pipelines, comparing scripted and declarative syntax
most recent commit 2 years ago
Dataplane ⭐ 197
Dataplane is an Airflow inspired data platform with additional data mesh capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
most recent commit 19 hours ago
Jenkins Pipeline Scripts ⭐ 184
most recent commit 4 years ago
Bob ⭐ 175
This is what CI/CD should've been.
most recent commit 19 days ago
Whirl ⭐ 173
Fast iterative local development and testing of Apache Airflow workflows
most recent commit a month ago
Continuouspipe ⭐ 165
The open-source continuous deployment pipeline for containerized applications
most recent commit 3 years ago
Demo Jenkins Config As Code ⭐ 158
Demo of Jenkins Configuration-As-Code with Docker and Groovy Hook Scripts
most recent commit 8 months ago
Jenkins Pipeline Kubernetes ⭐ 152
An example of a Jenkins CI/CD pipeline to Kubernetes
most recent commit 3 years ago
Cdeasy ⭐ 146
Continuous Delivery made Easy ;)
most recent commit 6 years ago
3musketeers ⭐ 143
Test, build, and deploy your apps from anywhere, the same way!
most recent commit 24 days ago
Oreilly Docker Java Shopping ⭐ 133
Code repository for my O'Reilly "Containerizing Continuous Delivery in Java: Docker Integration for Build Pipelines and Application Architecture" minibook
most recent commit a year ago
Terraform Aws Ecs Codepipeline ⭐ 128
Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/
most recent commit 2 months ago
Sarek ⭐ 126
Detect germline or somatic variants from normal or tumour/normal whole-genome or targeted sequencing
most recent commit 3 years ago
Flow Pipeline ⭐ 125
A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)
total releases 2most recent commit 3 months ago
Cloud Pipeline ⭐ 121
Cloud agnostic genomics analysis, scientific computation and storage platform
most recent commit 20 hours ago
Incubator Liminal ⭐ 121
Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.
total releases 25most recent commit 11 days ago
Delivery Pipeline Plugin ⭐ 120
Jenkins plugin for pipeline visualisation, perfect for Continuous Delivery
total releases 46most recent commit 2 years ago
Ifc Pipeline ⭐ 113
Processing queue and front-end for visualizing BIM models with IfcOpenShell, Docker Compose and Flask
most recent commit 3 months ago
Dockware ⭐ 108
Managed Shopware 6 Docker setups with dockware. Run any Shopware 6 version within minutes (locally) in Docker
most recent commit 10 days ago
Superglue ⭐ 102
Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs and reports.
most recent commit a year ago
Devops ⭐ 98
Hands-on with DevOps
most recent commit 2 years ago
Analysis Workflows ⭐ 97
Open workflow definitions for genomic analysis from MGI at WUSM.
most recent commit a month ago
Jenkins Phoenix ⭐ 95
Stateless Jenkins deployment with Docker
most recent commit 6 years ago
Pipeline As Code With Jenkins ⭐ 94
Pipeline as Code with Jenkins
most recent commit 2 months ago
Drone Runner Docker ⭐ 92
Drone runner that executes pipelines inside Docker containers
dependent packages 2total releases 24most recent commit 2 days ago
Pipehub ⭐ 92
A platform that pipelines web requests to WeChat/Telegram notifications.
most recent commit 2 months ago
Pipelines ⭐ 85
Pipelines - Run Bitbucket Pipelines Wherever They Dock
total releases 67most recent commit 7 months ago
Fastdeploy ⭐ 82
Deploy DL/ ML inference pipelines with minimal extra code.
total releases 40most recent commit 2 months ago
Enterpriseassetmanagement ⭐ 81
企业固定资产管理系统
most recent commit 4 years ago
Nanopype ⭐ 78
Snakemake pipelines for nanopore sequencing data archiving and processing
most recent commit a year ago
Ngseasy ⭐ 76
Dockerised Next Generation Sequencing Pipeline (QC, Align, Calling, Annotation)
most recent commit 6 years ago
Zika Rnaseq Pipeline ⭐ 73
An open RNA-Seq data analysis pipeline tutorial with an example of reprocessing data from a recent Zika virus study
most recent commit 3 years ago
Jenkins Pipeline ⭐ 73
📈 Learn how to implement container technologies with your Jenkins CI/CD workflows to make them easier to manage in this tutorial.
most recent commit 3 years ago
Ml_drought ⭐ 73
Machine learning to better predict and understand drought. Moving github.com/ml-clim
most recent commit a year ago
Lines ⭐ 71
A pure bash clojureish CI pipeline
most recent commit 2 years ago
Master_of_pores ⭐ 70
Nextflow pipeline for analysis of direct RNA Nanopore reads
most recent commit a year ago
Docker Stream ⭐ 68
CLI tool for automating the use of docker containers in streaming data processing pipelines. Works on Windows, Mac and Linux.
dependent packages 1total releases 8most recent commit 8 years agonpm docker-stream} Downloads
Tibanna ⭐ 68
Tibanna helps you run your genomic pipelines on Amazon cloud (AWS). It is used by the 4DN DCIC (4D Nucleome Data Coordination and Integration Center) to process data. Tibanna supports CWL/WDL (w/ docker), Snakemake (w/ conda) and custom Docker/shell command.
dependent packages 1total releases 236most recent commit 2 months agopypi tibanna} Downloads
Bacannot ⭐ 68
Generic but comprehensive pipeline for prokaryotic genome annotation and interrogation with interactive reports and shiny app.
most recent commit 16 days ago
Vent ⭐ 68
Vent is a light-weight platform built to automate network collection and analysis pipelines using a flexible set of popular open source tools and technologies. Vent is python-based, extensible, leverages docker containers, and provides both an API and CLI.
total releases 52most recent commit 3 years ago
Plant Seg ⭐ 67
A tool for cell instance aware segmentation in densely packed 3D volumetric images
most recent commit 9 days ago
Scancode.io ⭐ 66
ScanCode.io is a server to script and automate software composition analysis pipelines with ScanPipe pipelines. This project is sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase/ Google Summer of Code, nexB and others generous sponsors!
most recent commit 9 days ago
Devops Docker Images ⭐ 64
A collection of Dockerfiles for images that can be used to implement Continuous Delivery pipelines for SAP development projects with project "Piper" or any other CD tool.
most recent commit 5 months ago
Jenkins Pipeline Docker ⭐ 64
Containerized build environments with the Jenkins Pipeline plugin and Docker.
most recent commit 7 years ago
Data Processing Pipeline ⭐ 59
Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
most recent commit 6 years ago
Nanoclust ⭐ 59
NanoCLUST is an analysis pipeline for UMAP-based classification of amplicon-based full-length 16S rRNA nanopore reads
most recent commit 2 months ago
Oreilly Ai K8s Tutorial ⭐ 58
Materials for the "AI on Kubernetes" tutorial at O'Reilly AI SF 2018
most recent commit 4 years ago
Terraform Ecs Autoscale Alb ⭐ 58
ECS cluster with instance and service autoscaling configured and running behind an ALB with path based routing set up
most recent commit 3 years ago
Bifrost ⭐ 57
A stream processing framework for high-throughput applications.
most recent commit a month ago
M2g ⭐ 56
NeuroData's MRI to Graphs (m2g) - structural connectome estimation package and pipeline
total releases 79most recent commit 3 months ago
Ecs Pipeline ⭐ 56
☁️ 🐳 ⚡️ 🚀 Create environment and deployment pipelines to ECS Fargate with CodePipeline, CodeBuild and Github using Terraform
most recent commit 3 years ago
Ank ⭐ 55
Python data pipeline
total releases 11most recent commit 2 years ago
Dpg ⭐ 55
OpenMVG + OpenMVS Pipeline
most recent commit a year ago
Triton ⭐ 52
Media Processing Pipeline
most recent commit 3 years ago
Dockerfile Security ⭐ 51
Static security checker for Dockerfiles
most recent commit 2 years ago
Docker Partkeepr ⭐ 51
mhubig/partkeepr docker image repository
most recent commit 6 months ago
Anystatus ⭐ 50
A remote control for your CI/CD pipelines and more
most recent commit 3 months ago
Swarmci ⭐ 48
Swarm CI - Docker Swarm-based CI system or enhancement to existing systems.
most recent commit 6 years ago
Painless Continuous Delivery ⭐ 48
A cookiecutter for projects with continuous delivery baked in.
most recent commit 2 months ago
Ensembl Hive ⭐ 48
EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource
most recent commit 22 days ago
Component Based Rails Applications Book ⭐ 46
Code to the book Component-based Rails Applications (http://cbra.info)
most recent commit a year ago
Jenkins2 Docker ⭐ 46
most recent commit 7 years ago
Jenkins Pipeline Ci Cd With Helm On Kubernetes ⭐ 46
most recent commit 6 years ago
Devsecops Example Helloworld ⭐ 46
Example of a CI/CD Pipeline using Jenkins Multi-branch Pipelines hosted at AWS
most recent commit 5 years ago
Asap ⭐ 46
A scalable bacterial genome assembly, annotation and analysis pipeline
most recent commit 7 months ago
Yamp ⭐ 45
YAMP: Yet Another Metagenomic Pipeline
most recent commit 2 years ago
Pipelines Javascript Docker ⭐ 44
Sample Node.js Docker application referred to by Azure Pipelines documentation
most recent commit 2 months ago
Functions ⭐ 43
An Open Source Serverless Platform
total releases 32most recent commit 21 days ago
Pyconde2019 Airflow Ml Workshop ⭐ 42
PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
most recent commit a year ago
Devops 101 ⭐ 42
Intro to DevOps from scratch.
most recent commit a year ago
1-100 of 690 projects
Related Awesome Lists
Shell Docker Projects (20,150)
Python Docker Projects (13,757)
Golang Docker Projects (6,971)
Java Docker Projects (6,071)
Php Docker Projects (5,964)
Docker Dockerfile Projects (5,055)
Docker Nginx Projects (4,738)
Python Pipeline Projects (4,199)
Docker Server Projects (3,358)
Docker Mysql Projects (3,333)
Javascript Docker Projects (3,219)
Ruby Docker Projects (2,604)
Html Docker Projects (2,530)
Docker Aws Projects (2,453)
Docker Deployment Projects (2,446)
Docker Redis Projects (2,405)
Docker Kubernetes Projects (2,386)
Docker Microservice Projects (2,271)
Reactjs Docker Projects (2,256)
Docker Mongodb Projects (2,092)
Docker Database Projects (2,069)
Docker Registry Projects (1,988)
Jupyter Docker Projects (1,986)
Docker Postgresql Projects (1,853)
Docker Swarm Projects (1,851)
Docker Proxy Projects (1,759)
Docker Continuous Integration Projects (1,749)
Docker Cloud Computing Projects (1,662)
Docker Spring Projects (1,632)
Typescript Docker Projects (1,604)
Docker Cloud Projects (1,592)
Docker Elasticsearch Projects (1,535)
Docker Ci Projects (1,511)
C Sharp Docker Projects (1,493)
Jupyter Notebook Docker Projects (1,480)
Docker Spring Boot Projects (1,476)
Docker Apache Projects (1,357)
Javascript Pipeline Projects (1,357)
Docker Stack Projects (1,351)
Shell Pipeline Projects (1,143)
Pipeline Jenkins Projects (1,142)
Docker Vue Projects (1,140)
Docker Kafka Projects (1,106)
Docker Web Projects (1,076)
Docker Python3 Projects (982)
Jupyter Pipeline Projects (976)
Jupyter Notebook Pipeline Projects (944)
Docker Git Projects (900)
Java Pipeline Projects (868)
Docker Angular Projects (843)
Docker Azure Projects (816)
Docker Dashboard Projects (784)
Docker Graphql Projects (775)
Docker Swagger Projects (775)
Docker Django Projects (766)
Docker Daemon Projects (763)
Docker Ruby On Rails Projects (755)
Ruby Pipeline Projects (754)
Docker Ansible Projects (743)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,158,774)
Python  (891,361)
Java  (412,491)
Typescript  (307,126)
Php  (298,245)
C Plus Plus  (258,303)
Ruby  (225,235)
C  (194,028)
Shell  (182,694)
C Sharp  (178,694)
Golang  (172,254)
Swift  (69,083)
Rust  (68,890)
R  (62,239)
Dart  (62,107)
Objective C  (57,074)
Kotlin  (53,499)
Lua  (38,475)
Matlab  (32,900)
Perl  (30,838)
Language  (29,929)
Scala  (29,387)
Haskell  (20,945)
Powershell  (20,430)
Clojure  (19,572)
Bash  (19,219)
Elixir  (17,463)
Coffeescript  (17,143)
Assembly  (15,704)
Julia  (14,044)
Processing  (13,330)
Emacs Lisp  (10,862)
Basic  (10,672)
Flow  (10,511)
Solidity  (10,071)
Erlang  (9,122)
Groovy  (8,617)
Scheme  (8,439)
Ocaml  (6,958)
Pascal  (6,811)
Hack  (6,590)
Lisp  (6,359)
Fortran  (5,800)
Elm  (5,563)
Common Lisp  (5,469)
Shell Script  (4,848)
Dlang  (4,802)
Python Library  (4,520)
Crystal  (4,449)
F Sharp  (4,265)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.