Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Deep Learning Inference Open Source Projects

Open source projects categorized as Python Deep Learning Inference
Categories > Machine Learning > Deep Learning
Categories > Machine Learning > Inference
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Yolov3 ⭐ 9,865
YOLOv3 in PyTorch > ONNX > CoreML > TFLite
most recent commit 3 months ago
Text Generation Inference ⭐ 6,743
Large Language Model Text Generation Inference
dependent packages 5total releases 13most recent commit 3 months agopypi text-generation} Downloads
Serving ⭐ 6,045
A flexible, high-performance serving system for machine learning models
most recent commit 3 months ago
Nanodet ⭐ 5,416
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
most recent commit 4 months ago
3ddfa ⭐ 3,243
The PyTorch improved version of TPAMI 2017 paper: Face Alignment in Full Pose Range: A 3D Total Solution.
most recent commit 2 years ago
Transformer Deploy ⭐ 1,542
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
most recent commit 6 months ago
Keras_to_tensorflow ⭐ 1,508
General code to convert a trained keras model into an inference tensorflow model
most recent commit 3 years ago
Deepspeed Mii ⭐ 1,437
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
total releases 12most recent commit 3 months ago
Tensorflow 101 ⭐ 1,100
learn code with tensorflow
most recent commit 5 years ago
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 7 months agopypi paddle-serving-client} Downloads
Retinanet Examples ⭐ 727
Fast and accurate object detection with end-to-end GPU optimization
most recent commit 3 years ago
Pytorch Pruning ⭐ 655
PyTorch Implementation of [1611.06440] Pruning Convolutional Neural Networks for Resource Efficient Inference
most recent commit 5 years ago
Models ⭐ 635
Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Intel® Data Center GPUs
most recent commit 4 months ago
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13most recent commit 3 months agopypi nvidia-pytriton} Downloads
Trainyourownyolo ⭐ 609
Train a state-of-the-art yolov3 object detector from scratch!
most recent commit 2 years ago
Hidet ⭐ 577
An open-source efficient deep learning framework/compiler, written in python.
most recent commit 3 months ago
Torchlayers ⭐ 547
Shape and dimension inference (Keras-like) for PyTorch layers and neural networks
most recent commit 2 years ago
Pipeless ⭐ 534
An open-source computer vision framework to build and deploy apps in minutes
dependent packages 2total releases 20most recent commit 3 months agopypi pipeless-ai} Downloads
Convcrf ⭐ 496
This repository contains the reference implementation for our proposed Convolutional CRFs.
most recent commit 3 years ago
Pinferencia ⭐ 473
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
total releases 15most recent commit a year ago
Bayesian Torch ⭐ 396
A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch
dependent packages 1total releases 3most recent commit 4 months agopypi bayesian-torch} Downloads
Papers In 100 Lines Of Code ⭐ 395
Implementation of papers in 100 lines of code.
most recent commit 6 months ago
The 9 Most Depended On Python Deep Learning Inference Open Source Projects
Text Generation Inference ⭐ 6,743
Large Language Model Text Generation Inference
dependent packages 5total releases 13latest release September 28, 2023most recent commit 3 months agopypi text-generation} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Sagemaker Inference Toolkit ⭐ 336
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
dependent packages 4total releases 48latest release October 25, 2023most recent commit 5 months agopypi sagemaker-inference} Downloads
Midv 500 Models ⭐ 23
Model for document segmentation trained on the midv-500-models dataset.
dependent packages 3total releases 2latest release November 09, 2020most recent commit 3 years agopypi midv500models} Downloads
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3latest release June 08, 2022most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13latest release December 06, 2023most recent commit 3 months agopypi nvidia-pytriton} Downloads
Pipeless ⭐ 534
An open-source computer vision framework to build and deploy apps in minutes
dependent packages 2total releases 20latest release November 02, 2023most recent commit 3 months agopypi pipeless-ai} Downloads
Planer ⭐ 45
Powerful Light Artificial NEuRon inference framework for CNN
dependent packages 2total releases 27latest release March 06, 2022most recent commit 2 years agopypi planer} Downloads
Bayesian Torch ⭐ 396
A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch
dependent packages 1total releases 3latest release December 14, 2022most recent commit 4 months agopypi bayesian-torch} Downloads
The 10 Latest Releases In Python Deep Learning Inference Open Source Projects
Pytriton ⭐ 611
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
dependent packages 2total releases 13latest release December 06, 2023most recent commit 3 months agopypi nvidia-pytriton} Downloads
Deepspeed Mii ⭐ 1,437
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
total releases 12latest release December 01, 2023most recent commit 3 months ago
Fastdeploy ⭐ 90
Deploy DL/ ML inference pipelines with minimal extra code.
total releases 56latest release November 29, 2023most recent commit 4 months ago
Pipeless ⭐ 534
An open-source computer vision framework to build and deploy apps in minutes
dependent packages 2total releases 20latest release November 02, 2023most recent commit 3 months agopypi pipeless-ai} Downloads
Sagemaker Inference Toolkit ⭐ 336
Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
dependent packages 4total releases 48latest release October 25, 2023most recent commit 5 months agopypi sagemaker-inference} Downloads
Text Generation Inference ⭐ 6,743
Large Language Model Text Generation Inference
dependent packages 5total releases 13latest release September 28, 2023most recent commit 3 months agopypi text-generation} Downloads
Bayesflow ⭐ 216
A Python library for amortized Bayesian workflows using generative neural networks.
total releases 4latest release September 12, 2023most recent commit 4 months ago
Qonnx ⭐ 81
QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
total releases 4latest release July 28, 2023most recent commit 5 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.