Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for onnx tensorrt
onnx
x
tensorrt
x
86 search results found
Yolox
⭐
8,759
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
Tengine
⭐
4,452
Tengine is a lite, high performance, modular inference engine for embedded device
Pytorch Yolov4
⭐
4,340
PyTorch ,ONNX and TensorRT implementation of YOLOv4
Tnn
⭐
4,210
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
Damo Yolo
⭐
3,598
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
Yolov7_d2
⭐
3,130
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
Fastdeploy
⭐
2,547
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
Mmdeploy
⭐
2,371
OpenMMLab Model Deployment Framework
Micronet
⭐
2,177
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/in
Awesome Yolo Object Detection
⭐
1,047
🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.
Yolov8 Tensorrt
⭐
895
YOLOv8 using TensorRT accelerate !
Tiny Tensorrt
⭐
739
Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型
Inference
⭐
716
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
Pytorch Auto Drive
⭐
713
PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help
Yolort
⭐
705
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
Stable Diffusion Ncnn
⭐
701
Stable Diffusion in NCNN with c++, supported txt2img and img2img
Deepvac
⭐
618
PyTorch Project Specification.
Mmdetection To Tensorrt
⭐
562
convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
X Stable Diffusion
⭐
523
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.
Forward
⭐
491
A library for high performance deep learning inference on NVIDIA GPUs.
Insightface Rest
⭐
436
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
Centerx
⭐
430
This repo is implemented based on detectron2 and centernet
Tensorrt
⭐
370
TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
Edgeyolo
⭐
350
an edge-real-time anchor-free object detector with decent performance
Pytorch Tutorial 2nd
⭐
266
《Pytorch实用教程——第二版》无论是零基础入门,还是进阶工程化部署落地,在这里都有。相信在本书 PyTorch 的使用,成为一名优秀的深度学习工程师。
Openvino2tensorflow
⭐
262
This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and pb. PyTorch (NCHW) -> ONNX (NCHW) -> OpenVINO (NCHW) -> openvino2tensorflow -> Tensorflow/Keras (NHWC/NCHW) -> TFLite (NHWC/NCHW). And the conversion from .pb to saved_model and from saved_model to .pb and from .pb to .tflite and saved_model to .tflite and saved_model to onnx. Support for building environments with Docker. It is possible to directly access the
Volksdep
⭐
214
volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
Deepstream_pose_estimation
⭐
210
This is a sample DeepStream application to demonstrate a human pose estimation pipeline.
Vs Mlrt
⭐
189
Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)
Tflite2tensorflow
⭐
186
Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.
Centerpoint
⭐
167
Export CenterPoint PonintPillars ONNX Model For TensorRT
Centernet Tensorrt
⭐
143
This is a C++ implementation of CenterNet using TensorRT and CUDA
Lightglue Onnx
⭐
141
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
Torch Model Compression
⭐
137
针对pytorch模型的自动化模型结构分析和修改工具集,包含自动分析模型结构的模型压缩算法库
Ml Model Ci
⭐
135
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Pytorch_onnx_tensorrt
⭐
112
A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
Play_with_tensorrt
⭐
101
Sample projects for TensorRT in C++
Nutonomy_pointpillars
⭐
88
Convert pointpillars Pytorch Model To ONNX for TensorRT Inference
Gst Inference
⭐
86
A GStreamer Deep Learning Inference Framework
Tensorrt_cv
⭐
78
🚀🚀🚀NVIDIA TensorRT 加速推断教程!
Easy_vitpose
⭐
67
Easy and fast 2d human and animal multi pose estimation using SOTA ViTPose [Y. Xu et al., 2022] Real-time performances and multiple skeletons supported.
Livechess2fen
⭐
57
Predict live chess games into FEN notation.
Headposeestimation Whenet Yolov4 Onnx Openvino
⭐
51
WHENet - ONNX, OpenVINO, TFLite, TensorRT, EdgeTPU, CoreML, TFJS, YOLOv4/YOLOv4-tiny-3L
Stable Diffusion Tritonserver
⭐
49
Deploy stable diffusion model with onnx/tenorrt + tritonserver
Dmhead
⭐
49
Dual model head pose estimation. Fusion of SOTA models. 360° 6D HeadPose detection. All pre-processing and post-processing are fused together, allowing end-to-end processing in a single inference.
Yolo Tensorrt8
⭐
47
Generate ONNX for YOLO-TensorRT8
Ai Lab
⭐
44
This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥
Yolov5_tensorrt_int8_tools
⭐
42
tensorrt int8 量化yolov5 onnx模型
Tensorrt Cv
⭐
38
Using TensorRT for Inference Model Deployment.
Opti_models
⭐
38
PyTorch optimizations and benchmarking
Pytorch Onnx Tensorrt
⭐
35
A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3
Turnkeyml
⭐
34
The AI insights toolchain
Cheetahinfer
⭐
33
A C++ inference SDK based on TensorRT
Yolo Models For Valorant
⭐
33
Valorant Models in Yolov5 and Yolov7
Tensorrt_seg_lw_refinenet
⭐
32
一个简单的TensorRT实现语义分割的C++程序
Infery Examples
⭐
28
A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).
Amuse
⭐
27
.NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within the .NET eco-system
Person Detection
⭐
23
TensorRT person tracking RFBNet300
Deephawkeye
⭐
22
image anomaly detection
Model Inference Deployment
⭐
21
A curated list of awesome inference deployment framework of artificial intelligence models.
Onnx Runtime With Tensorrt And Openvino
⭐
21
Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
Tensorrt2onnx
⭐
20
A tool convert TensorRT engine/plan to a fake onnx
Yolact_edge_onnx_tensorrt_myriad
⭐
19
Provides a conversion flow for YOLACT_Edge to models compatible with ONNX, TensorRT, OpenVINO and Myriad (OAK). My own implementation of post-processing allows for e2e inference. Support for Multi-Class NonMaximumSuppression, CombinedNonMaxSuppression.
Dedode Onnx Tensorrt
⭐
17
ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀
Mtomo
⭐
17
Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.
Sit4onnx
⭐
17
Tools for simple inference testing using TensorRT, CUDA and OpenVINO CPU/GPU and CPU providers. Simple Inference Test for ONNX.
Mediapipe_plus
⭐
16
The purpose of this project is to apply mediapipe to more AI chips.
Facemesh_onnx_tensorrt
⭐
16
Verify that the post-processing merged into FaceMesh works correctly. The object detection model can be anything other than BlazeFace. YOLOv4 and FaceMesh committed to this repository have modified post-processing.
Sparseinst_tensorrt
⭐
14
The real-time Instance Segmentation Algorithm SparseInst running on TensoRT and ONNX
Onnx2tensorrt
⭐
14
tensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version
Netspresso Trainer
⭐
13
A library for training, compressing and deploying computer vision models (including ViT) with edge devices
Yolov3 Tensorrt Py
⭐
13
Yolov3 on tensorflow2.0 and tensorrt7.0
Onnx Model Zoo
⭐
13
This GitHub repository contains converted models in ONNX, TensorRT, and PyTorch formats, along with inference scripts and demos. These models can be used for efficient deployment and inference in machine learning applications.
Image Animation Turbo Boost
⭐
13
Aim to accelerate the image-animation-model inference through the inference frameworks such as onnx、tensorrt and openvino.
Whisper Onnx Tensorrt
⭐
12
ONNX and TensorRT implementation of Whisper
Tensorrt Compatibility
⭐
12
Script to check ONNX model compatibility against TensorRT versions using docker images
Nne
⭐
10
convert a pytorch model to a model for edge device
Animejanaiconvertergui
⭐
10
GUI for upscaling ESRGAN ONNX models with NVIDIA TensorRT and Vapoursynth
Yolov5 Tensorrt
⭐
9
Real-time object detection with YOLOv5 and TensorRT
Bot Sort Onnx Tensorrt
⭐
9
BoT-SORT + YOLOX implemented using only onnxruntime, Numpy and scipy, without cython_bbox and PyTorch. Fast human tracker. OSNet is not used.
Yolov8 Onnx Rknn Horizon Tensorrt Segmentation
⭐
9
Inference YOLOv8 segmentation on ONNX, RKNN, Horizon and TensorRT
Pytorch_infer_utils
⭐
9
This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.
Tensorrt Deformable Detr
⭐
8
Tensorrt-Deformable-Detr
Trt_yolo_ros
⭐
7
yolov3 ros node using tensorrt acceleration
Centernet Onnx Tensorrt
⭐
6
centernet to onnx and to tensorrt
Ai Edge Computing Tiny Embedded
⭐
6
1-86 of 86 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.