Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Deep Learning Gpu Inference Open Source Projects

Open source projects categorized as Deep Learning Gpu Inference
Categories > Machine Learning > Deep Learning
Categories > Hardware > Gpu
Categories > Machine Learning > Inference
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79most recent commit 17 days agopypi deepspeed} Downloads
Yolov3 ⭐ 9,865
YOLOv3 in PyTorch > ONNX > CoreML > TFLite
most recent commit 3 months ago
Server ⭐ 7,321
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
total releases 64most recent commit 2 days ago
Nanodet ⭐ 5,416
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
most recent commit 4 months ago
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22most recent commit 3 months agopypi torchserve} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103most recent commit 3 months agopypi ctranslate2} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 7 months agopypi paddle-serving-client} Downloads
Polyrnn Pp ⭐ 674
Inference Code for Polygon-RNN++ (CVPR 2018)
most recent commit 6 years ago
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13most recent commit 3 months agopypi nvidia-pytriton} Downloads
Trainyourownyolo ⭐ 609
Train a state-of-the-art yolov3 object detector from scratch!
most recent commit 2 years ago
Forward ⭐ 491
A library for high performance deep learning inference on NVIDIA GPUs.
most recent commit 2 years ago
Gpu Rest Engine ⭐ 391
A REST API for Caffe using Docker and Go
most recent commit 6 years ago
Model_analyzer ⭐ 336
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
most recent commit 3 months ago
Bmw Tensorflow Inference Api Gpu ⭐ 310
This is a repository for an object detection inference API using the Tensorflow framework.
most recent commit 2 years ago
Bmw Yolov4 Inference Api Gpu ⭐ 276
This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
most recent commit 2 years ago
Ergo ⭐ 263
🧠 A tool that makes AI easier.
total releases 13most recent commit 3 years ago
Tensorrt Laboratory ⭐ 193
Explore the Capabilities of the TensorRT Platform
most recent commit 4 years ago
Nimble ⭐ 169
Lightweight and Parallel Deep Learning Framework
most recent commit 3 years ago
Model_navigator ⭐ 139
Triton Model Navigator is a tool that provides the ability to automate the process of model deployment on the Triton Inference Server.
total releases 19most recent commit 4 months ago
Deeperlab Pytorch ⭐ 138
Segmentation realize Deeperlab only segmentation part
most recent commit 3 years ago
Edl ⭐ 135
Elastic Deep Learning for deep learning framework on Kubernetes
total releases 4most recent commit 3 years ago
Hyper Table Ocr ⭐ 110
A carefully-designed OCR pipeline for universal boarded table recognition and reconstruction.
most recent commit a year ago
The 6 Most Depended On Deep Learning Gpu Inference Open Source Projects
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit 17 days agopypi deepspeed} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22latest release October 12, 2023most recent commit 3 months agopypi torchserve} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13latest release December 06, 2023most recent commit 3 months agopypi nvidia-pytriton} Downloads
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3latest release June 08, 2022most recent commit 3 months agopypi ultralytics-yolov5} Downloads
The 10 Latest Releases In Deep Learning Gpu Inference Open Source Projects
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13latest release December 06, 2023most recent commit 3 months agopypi nvidia-pytriton} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit 17 days agopypi deepspeed} Downloads
Server ⭐ 7,321
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
total releases 64latest release October 27, 2023most recent commit 2 days ago
Serve ⭐ 3,844
Serve, optimize and scale PyTorch models in production
dependent packages 15total releases 22latest release October 12, 2023most recent commit 3 months agopypi torchserve} Downloads
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3latest release June 08, 2022most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Ergo ⭐ 263
🧠 A tool that makes AI easier.
total releases 13latest release January 19, 2021most recent commit 3 years ago
Edl ⭐ 135
Elastic Deep Learning for deep learning framework on Kubernetes
total releases 4latest release July 30, 2020most recent commit 3 years ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.