Awesome Open Source

Programming Languages

Search results for tensorrt

295 search results found

Tensorrt ⭐ 8,908

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Yolox ⭐ 8,759

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

Jetson Inference ⭐ 7,038

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Tensorrtx ⭐ 6,315

Implementation of popular deep learning networks with TensorRT network definition API

Yolo_tracking ⭐ 6,182

BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models

Tengine ⭐ 4,452

Tengine is a lite, high performance, modular inference engine for embedded device

Pytorch Yolov4 ⭐ 4,340

PyTorch ,ONNX and TensorRT implementation of YOLOv4

Torch2trt ⭐ 4,267

An easy to use PyTorch to TensorRT converter

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

Damo Yolo ⭐ 3,598

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

Yolov7_d2 ⭐ 3,131

🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥

Fastdeploy ⭐ 2,547

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Deepdetect ⭐ 2,492

Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Tensorrt_pro ⭐ 2,411

C++ library based on tensorrt integration

Mmdeploy ⭐ 2,371

OpenMMLab Model Deployment Framework

Tensorrt ⭐ 2,308

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Micronet ⭐ 2,177

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/in

Tensorflow Yolov4 Tflite ⭐ 2,135

YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite

Yolov5 Lite ⭐ 1,975

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Cvprojects ⭐ 1,827

computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）

Yolov5 Face ⭐ 1,791

YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)

Tensorrt_demos ⭐ 1,615

TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet

Berrynet ⭐ 1,563

Deep learning gateway on Raspberry Pi and other edge devices

Paddleslim ⭐ 1,486

PaddleSlim is an open-source library for deep model compression and architecture search.

Hyperpose ⭐ 1,242

Library for Fast and Flexible Human Pose Estimation

Deepstream Yolo ⭐ 1,184

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models

Bisenet ⭐ 1,130

Add bisenetv2. My implementation of BiSeNet

Awesome Yolo Object Detection ⭐ 1,047

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.

Radiata ⭐ 984

Stable diffusion webui based on diffusers.

Tensorrt Alpha ⭐ 971

🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YO IS ALL YOU NEED.🍎🍎🍎

Yolov8 Tensorrt ⭐ 895

YOLOv8 using TensorRT accelerate !

Fastmot ⭐ 786

High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀

Trt_pose ⭐ 763

Real-time pose estimation accelerated with NVIDIA TensorRT

Tiny Tensorrt ⭐ 739

Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型

Retinanet Examples ⭐ 727

Fast and accurate object detection with end-to-end GPU optimization

Inference ⭐ 716

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

Pytorch Auto Drive ⭐ 713

PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Stable Diffusion Ncnn ⭐ 701

Stable Diffusion in NCNN with c++, supported txt2img and img2img

Adlik: Toolkit for Accelerating Deep Learning Inference

Tf_trt_models ⭐ 679

TensorFlow models accelerated with NVIDIA TensorRT

Tensorrt For Yolo Series ⭐ 636

tensorrt for yolo series (YOLOv8, YOLOv7, YOLOv6....), nms plugin support

Deepvac ⭐ 618

PyTorch Project Specification.

YOLOv3、YOLOv4、YOLOv5、YOLOv5-Lite、YOLOv6-v1、YOLOv6- v2、FastestDet、YOLOv5-SPD、TensorRT、NCNN、Tengine、Ope

Flexible Yolov5 ⭐ 607

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.

Mmdetection To Tensorrt ⭐ 562

convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

Yolov4 Custom Functions ⭐ 533

A Wide Range of Custom Functions for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny Implemented in TensorFlow, TFLite, and TensorRT.

X Stable Diffusion ⭐ 523

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

Fasterseg ⭐ 523

[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang

Tensorflow 2.x Yolov3 ⭐ 521

YOLOv3 implementation in TensorFlow 2.3.1

Whisperlive ⭐ 505

A nearly-live implementation of OpenAI's Whisper.

Forward ⭐ 491

A library for high performance deep learning inference on NVIDIA GPUs.

Generativeaiexamples ⭐ 458

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Tf_to_trt_image_classification ⭐ 454

Image classification with NVIDIA TensorRT from TensorFlow models.

Insightface Rest ⭐ 436

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

Enhancr ⭐ 436

Video Frame Interpolation & Super Resolution using NVIDIA's TensorRT & Tencent's NCNN inference, beautifully crafted and packaged into a single app

Centerx ⭐ 430

This repo is implemented based on detectron2 and centernet

Python Computer Vision & Video Analytics Framework With Batteries Included

Nanosam ⭐ 388

A distilled Segment Anything (SAM) model capable of running real-time with NVIDIA TensorRT

Tflite_gles_app ⭐ 387

GPU accelerated deep learning inference applications for RaspberryPi / JetsonNano / Linux PC using TensorflowLite GPUDelegate / TensorRT

Jetson Nano Ubuntu 20 Image ⭐ 382

Jetson Nano with Ubuntu 20.04 image

Tensorrt Yolov3 ⭐ 375

TensorRT for Yolov3

Tensorrt ⭐ 370

TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等可训练自己数据

Tensorrt Cpp Api ⭐ 354

TensorRT C++ API Tutorial

Edgeyolo ⭐ 350

an edge-real-time anchor-free object detector with decent performance

Cv Detect Robot ⭐ 346

🔥🔥🔥🔥🔥🔥Docker NVIDIA Docker2 YOLOV5 YOLOX YOLO Deepsort TensorRT ROS Deepstream Jetson Nano TX2 NX for High-performance deployment(高性能部署)

Deepstream_tao_apps ⭐ 323

Sample apps to demonstrate how to deploy models trained with TAO on DeepStream

Yolov8 Tensorrt Cpp ⭐ 306

YOLOv8 TensorRT C++ Implementation

Nndeploy ⭐ 303

nndeploy is a cross-platform, high-performing, and straightforward AI model deployment framework. We strive to deliver a consistent and user-friendly experience across various inference framework backends in complex deployment environments and focus on performance.

Sparsebit ⭐ 291

A model compression and acceleration toolbox based on pytorch.

Pytorch Tutorial 2nd ⭐ 266

《Pytorch实用教程——第二版》无论是零基础入门，还是进阶工程化部署落地，在这里都有。相信在本书 PyTorch 的使用，成为一名优秀的深度学习工程师。

Openvino2tensorflow ⭐ 262

This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and pb. PyTorch (NCHW) -> ONNX (NCHW) -> OpenVINO (NCHW) -> openvino2tensorflow -> Tensorflow/Keras (NHWC/NCHW) -> TFLite (NHWC/NCHW). And the conversion from .pb to saved_model and from saved_model to .pb and from .pb to .tflite and saved_model to .tflite and saved_model to onnx. Support for building environments with Docker. It is possible to directly access the

Bonnet: An Open-Source Training and Deployment Framework for Semantic Segmentation in Robotics.

Centerpoint ⭐ 250

TensorRT deployment for CenterPoint Lidar Detection Model.

Centermulti ⭐ 239

基于CenterNet训练的目标检测&人脸对齐&姿态估计模型

Object detection for video surveillance

Volksdep ⭐ 214

volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.

Deepstream_pose_estimation ⭐ 210

This is a sample DeepStream application to demonstrate a human pose estimation pipeline.

Yolox Ros ⭐ 209

YOLOX + ROS2 object detection package (C++ only support)

Tensorrt Laboratory ⭐ 193

Explore the Capabilities of the TensorRT Platform

Vs Mlrt ⭐ 189

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

Tflite2tensorflow ⭐ 186

Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

Yolov4 Triton Tensorrt ⭐ 184

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server

Mpv Upscale 2x_animejanai ⭐ 182

Real-time anime upscaling to 4k in mpv with Real-ESRGAN compact models

Self Driving Ish_computer_vision_system ⭐ 181

This project generates images you've probably seen in autonomous driving demo. Object Detection, Lane Detection, Road Segmentation, Depth Estimation using TensorRT

Mobilenet Ssd Tensorrt ⭐ 176

Accelerate mobileNet-ssd with tensorRT

Retinaface ⭐ 171

Reimplement RetinaFace use C++ and TensorRT

Centerpoint ⭐ 167

Export CenterPoint PonintPillars ONNX Model For TensorRT

Facealgorithm ⭐ 147

face detection face recognition包含人脸检测(retinaface,yolov5face,yolov7face

Ros Yolo Sort ⭐ 144

YOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)

Centernet Tensorrt ⭐ 143

This is a C++ implementation of CenterNet using TensorRT and CUDA

Lightglue Onnx ⭐ 141

ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO

Torch Model Compression ⭐ 137

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

Ml Model Ci ⭐ 135

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

Feature Detection Matching Algorithm ⭐ 130

🚀 Deep learning includes superpoint-superglue(C++, TensorRT), and traditional algorithms include zkaze, surf, ORB, etc.

Libdeepvac ⭐ 122

Use PyTorch model in C++ project

Dlcookbook Dlbs ⭐ 120

Deep Learning Benchmarking Suite

Inferencehelper ⭐ 119

C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow

Deepstream Python ⭐ 116

NVIDIA Deepstream 6.1 Python boilerplate

1-100 of 295 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.