Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for tensorrt onnxruntime
onnxruntime
x
tensorrt
x
24 search results found
Fastdeploy
⭐
2,547
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
Mmdeploy
⭐
2,371
OpenMMLab Model Deployment Framework
Yolov5 Lite
⭐
1,975
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
Yolort
⭐
705
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
X Stable Diffusion
⭐
523
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.
Nndeploy
⭐
303
nndeploy is a cross-platform, high-performing, and straightforward AI model deployment framework. We strive to deliver a consistent and user-friendly experience across various inference framework backends in complex deployment environments and focus on performance.
Yolox Ros
⭐
209
YOLOX + ROS2 object detection package (C++ only support)
Vs Mlrt
⭐
189
Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)
Lightglue Onnx
⭐
141
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
Gst Inference
⭐
86
A GStreamer Deep Learning Inference Framework
Vehicle Cv Adas
⭐
85
The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv8 and Ultra-Fast-Lane-Detection-v2 .
Cvu
⭐
64
Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.
Livechess2fen
⭐
57
Predict live chess games into FEN notation.
Setup Deeplearning Tools
⭐
41
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Object Detection Inference
⭐
37
C++ object detection inference from video or image input source
Pytorch Onnx Tensorrt
⭐
35
A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3
Infery Examples
⭐
28
A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).
Amuse
⭐
27
.NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within the .NET eco-system
Onnx Runtime With Tensorrt And Openvino
⭐
21
Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
Model Inference Deployment
⭐
21
A curated list of awesome inference deployment framework of artificial intelligence models.
Sit4onnx
⭐
17
Tools for simple inference testing using TensorRT, CUDA and OpenVINO CPU/GPU and CPU providers. Simple Inference Test for ONNX.
Dedode Onnx Tensorrt
⭐
17
ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀
Tensorrt Experiment
⭐
10
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
Pytorch_infer_utils
⭐
9
This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.
Bot Sort Onnx Tensorrt
⭐
9
BoT-SORT + YOLOX implemented using only onnxruntime, Numpy and scipy, without cython_bbox and PyTorch. Fast human tracker. OSNet is not used.
Cgistereo_demo
⭐
6
CGI-Stereo Python Inference Demo
Ai Edge Computing Tiny Embedded
⭐
6
1-24 of 24 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.