Awesome Open Source

Programming Languages

Search results for onnx tensorrt

75 search results found

Yolox ⭐ 9,579

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

Tengine ⭐ 4,452

Tengine is a lite, high performance, modular inference engine for embedded device

Pytorch Yolov4 ⭐ 4,340

PyTorch ,ONNX and TensorRT implementation of YOLOv4

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

Fastdeploy ⭐ 2,547

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Mmdeploy ⭐ 2,371

OpenMMLab Model Deployment Framework

Micronet ⭐ 2,212

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/in

Yolov8 Tensorrt ⭐ 895

YOLOv8 using TensorRT accelerate !

Tiny Tensorrt ⭐ 739

Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Inference ⭐ 716

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

Pytorch Auto Drive ⭐ 713

PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help

Stable Diffusion Ncnn ⭐ 701

Stable Diffusion in NCNN with c++, supported txt2img and img2img

Deepvac ⭐ 618

PyTorch Project Specification.

Mmdetection To Tensorrt ⭐ 562

convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

X Stable Diffusion ⭐ 523

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

Forward ⭐ 491

A library for high performance deep learning inference on NVIDIA GPUs.

Insightface Rest ⭐ 436

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

Centerx ⭐ 430

This repo is implemented based on detectron2 and centernet

Edgeyolo ⭐ 350

an edge-real-time anchor-free object detector with decent performance

Pytorch Tutorial 2nd ⭐ 266

《Pytorch实用教程——第二版》无论是零基础入门，还是进阶工程化部署落地，在这里都有。相信在本书 PyTorch 的使用，成为一名优秀的深度学习工程师。

Openvino2tensorflow ⭐ 262

This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and pb. PyTorch (NCHW) -> ONNX (NCHW) -> OpenVINO (NCHW) -> openvino2tensorflow -> Tensorflow/Keras (NHWC/NCHW) -> TFLite (NHWC/NCHW). And the conversion from .pb to saved_model and from saved_model to .pb and from .pb to .tflite and saved_model to .tflite and saved_model to onnx. Support for building environments with Docker. It is possible to directly access the

Volksdep ⭐ 214

volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.

Deepstream_pose_estimation ⭐ 210

This is a sample DeepStream application to demonstrate a human pose estimation pipeline.

Vs Mlrt ⭐ 189

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

Tflite2tensorflow ⭐ 186

Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

Centerpoint ⭐ 167

Export CenterPoint PonintPillars ONNX Model For TensorRT

Centernet Tensorrt ⭐ 143

This is a C++ implementation of CenterNet using TensorRT and CUDA

Lightglue Onnx ⭐ 141

ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO

Torch Model Compression ⭐ 137

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

Ml Model Ci ⭐ 135

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

Pytorch_onnx_tensorrt ⭐ 112

A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX

Play_with_tensorrt ⭐ 101

Sample projects for TensorRT in C++

Nutonomy_pointpillars ⭐ 88

Convert pointpillars Pytorch Model To ONNX for TensorRT Inference

Easy_vitpose ⭐ 67

Easy and fast 2d human and animal multi pose estimation using SOTA ViTPose [Y. Xu et al., 2022] Real-time performances and multiple skeletons supported.

Livechess2fen ⭐ 57

Predict live chess games into FEN notation.

Headposeestimation Whenet Yolov4 Onnx Openvino ⭐ 51

WHENet - ONNX, OpenVINO, TFLite, TensorRT, EdgeTPU, CoreML, TFJS, YOLOv4/YOLOv4-tiny-3L

Dual model head pose estimation. Fusion of SOTA models. 360° 6D HeadPose detection. All pre-processing and post-processing are fused together, allowing end-to-end processing in a single inference.

Stable Diffusion Tritonserver ⭐ 49

Deploy stable diffusion model with onnx/tenorrt + tritonserver

Yolo Tensorrt8 ⭐ 47

Generate ONNX for YOLO-TensorRT8

This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥

Yolov5_tensorrt_int8_tools ⭐ 42

tensorrt int8 量化yolov5 onnx模型

Opti_models ⭐ 38

PyTorch optimizations and benchmarking

Tensorrt Cv ⭐ 38

Using TensorRT for Inference Model Deployment.

Pytorch Onnx Tensorrt ⭐ 35

A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3

Turnkeyml ⭐ 34

The AI insights toolchain

Yolo Models For Valorant ⭐ 33

Valorant Models in Yolov5 and Yolov7

Tensorrt_seg_lw_refinenet ⭐ 32

一个简单的TensorRT实现语义分割的C++程序

Infery Examples ⭐ 28

A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).

.NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within the .NET eco-system

Person Detection ⭐ 23

TensorRT person tracking RFBNet300

Deephawkeye ⭐ 22

image anomaly detection

Onnx Runtime With Tensorrt And Openvino ⭐ 21

Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment

Model Inference Deployment ⭐ 21

A curated list of awesome inference deployment framework of artificial intelligence models.

Tensorrt2onnx ⭐ 20

A tool convert TensorRT engine/plan to a fake onnx

Yolact_edge_onnx_tensorrt_myriad ⭐ 19

Provides a conversion flow for YOLACT_Edge to models compatible with ONNX, TensorRT, OpenVINO and Myriad (OAK). My own implementation of post-processing allows for e2e inference. Support for Multi-Class NonMaximumSuppression, CombinedNonMaxSuppression.

Dedode Onnx Tensorrt ⭐ 17

ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀

Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.

Mediapipe_plus ⭐ 16

The purpose of this project is to apply mediapipe to more AI chips.

Facemesh_onnx_tensorrt ⭐ 16

Verify that the post-processing merged into FaceMesh works correctly. The object detection model can be anything other than BlazeFace. YOLOv4 and FaceMesh committed to this repository have modified post-processing.

Onnx2tensorrt ⭐ 14

tensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version

Onnx Model Zoo ⭐ 13

This GitHub repository contains converted models in ONNX, TensorRT, and PyTorch formats, along with inference scripts and demos. These models can be used for efficient deployment and inference in machine learning applications.

Yolov3 Tensorrt Py ⭐ 13

Yolov3 on tensorflow2.0 and tensorrt7.0

Image Animation Turbo Boost ⭐ 13

Aim to accelerate the image-animation-model inference through the inference frameworks such as onnx、tensorrt and openvino.

Netspresso Trainer ⭐ 13

A library for training, compressing and deploying computer vision models (including ViT) with edge devices

convert a pytorch model to a model for edge device

Animejanaiconvertergui ⭐ 10

GUI for upscaling ESRGAN ONNX models with NVIDIA TensorRT and Vapoursynth

Yolov8 Onnx Rknn Horizon Tensorrt Segmentation ⭐ 9

Inference YOLOv8 segmentation on ONNX, RKNN, Horizon and TensorRT

Bot Sort Onnx Tensorrt ⭐ 9

BoT-SORT + YOLOX implemented using only onnxruntime, Numpy and scipy, without cython_bbox and PyTorch. Fast human tracker. OSNet is not used.

Yolov5 Tensorrt ⭐ 9

Real-time object detection with YOLOv5 and TensorRT

Pytorch_infer_utils ⭐ 9

This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.

Tensorrt Deformable Detr ⭐ 8

Tensorrt-Deformable-Detr

Trt_yolo_ros ⭐ 7

yolov3 ros node using tensorrt acceleration

Centernet Onnx Tensorrt ⭐ 6

centernet to onnx and to tensorrt

Ai Edge Computing Tiny Embedded ⭐ 6

1-75 of 75 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2025 Awesome Open Source. All rights reserved.