Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Docker Inference Open Source Projects

Open source projects categorized as Docker Inference
Categories > Virtualization > Docker
Categories > Machine Learning > Inference
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22most recent commit 3 months agopypi torchserve} Downloads
Turbotransformers ⭐ 1,322
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.
most recent commit 10 months ago
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 7 months agopypi paddle-serving-client} Downloads
Inference ⭐ 716
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
total releases 17most recent commit 3 months ago
X Stable Diffusion ⭐ 523
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.
most recent commit 5 months ago
Insightface Rest ⭐ 436
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
most recent commit 3 months ago
Uniter ⭐ 418
Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
most recent commit 3 years ago
Gpu Rest Engine ⭐ 391
A REST API for Caffe using Docker and Go
most recent commit 6 years ago
Sagemaker Inference Toolkit ⭐ 336
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
dependent packages 4total releases 48most recent commit 5 months agopypi sagemaker-inference} Downloads
Bmw Tensorflow Inference Api Gpu ⭐ 310
This is a repository for an object detection inference API using the Tensorflow framework.
most recent commit 2 years ago
Dl_inference ⭐ 303
通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训
most recent commit 2 years ago
Bmw Labeltool Lite ⭐ 288
This repository provides you with an easy-to-use labeling tool for State-of-the-art Deep Learning training purposes. It supports Auto-Labeling.
most recent commit a year ago
Bmw Yolov4 Inference Api Gpu ⭐ 276
This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
most recent commit 2 years ago
Bmw Yolov4 Inference Api Cpu ⭐ 212
This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
most recent commit 2 years ago
Yolov4 Triton Tensorrt ⭐ 184
This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
most recent commit 2 years ago
Bmw Tensorflow Inference Api Cpu ⭐ 182
This is a repository for an object detection inference API using the Tensorflow framework.
most recent commit 2 years ago
Sagemaker Tensorflow Serving Container ⭐ 171
A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.
total releases 24most recent commit 7 months ago
Dynbenchmark ⭐ 167
Comparison of methods for trajectory inference on single-cell data 🥇
most recent commit 8 months ago
Onnx Runtime Inference ⭐ 141
ONNX Runtime Inference C++ Example
most recent commit a year ago
Bmw Anonymization Api ⭐ 137
This repository allows you to anonymize sensitive information in images/videos. The solution is fully compatible with the DL-based training/inference solutions that we already published/will publish for Object Detection and Semantic Segmentation.
most recent commit 2 years ago
Mnist_draw ⭐ 135
This is a sample project demonstrating the use of Keras (Tensorflow) for the training of a MNIST model for handwriting recognition using CoreML on iOS 11 for inference.
most recent commit 4 years ago
Object Detection And Image Segmentation With Detectron2 ⭐ 131
Object Detection and Image Segmentation with Detectron2
most recent commit 2 years ago
Kafka Ml ⭐ 131
Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)
most recent commit 3 months ago
The 3 Most Depended On Docker Inference Open Source Projects
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22latest release October 12, 2023most recent commit 3 months agopypi torchserve} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Sagemaker Inference Toolkit ⭐ 336
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
dependent packages 4total releases 48latest release October 25, 2023most recent commit 5 months agopypi sagemaker-inference} Downloads
The 8 Latest Releases In Docker Inference Open Source Projects
Fastdeploy ⭐ 90
Deploy DL/ ML inference pipelines with minimal extra code.
total releases 56latest release November 29, 2023most recent commit 4 months ago
Sagemaker Inference Toolkit ⭐ 336
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
dependent packages 4total releases 48latest release October 25, 2023most recent commit 5 months agopypi sagemaker-inference} Downloads
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22latest release October 12, 2023most recent commit 3 months agopypi torchserve} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Posecamera ⭐ 7
PoseCamera: Realtime Human Pose Estimation Python SDK
total releases 3latest release July 07, 2021most recent commit 3 years ago
Htsinfer ⭐ 7
HTSinfer infers metadata from Illumina high throughput sequencing (HTS) data
total releases 1latest release June 04, 2020most recent commit 3 months ago
Popular Virtualization Categories
Docker
Kubernetes
Dockerfile
Virtual Machine
Vagrant
Docker Image
Docker Compose
Hub
Docker Container
Virtualbox
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.