Awesome Open Source

Programming Languages

Search results for c plus plus tensorrt

94 search results found

Jetson Inference ⭐ 7,038

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Tensorrtx ⭐ 6,315

Implementation of popular deep learning networks with TensorRT network definition API

Tengine ⭐ 4,452

Tengine is a lite, high performance, modular inference engine for embedded device

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

Fastdeploy ⭐ 2,547

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Deepdetect ⭐ 2,492

Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Yolov5 Lite ⭐ 1,975

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Cvprojects ⭐ 1,827

computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）

Deepstream Yolo ⭐ 1,184

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models

Tensorrt Alpha ⭐ 971

🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YO IS ALL YOU NEED.🍎🍎🍎

Yolov8 Tensorrt ⭐ 895

YOLOv8 using TensorRT accelerate !

Tiny Tensorrt ⭐ 739

Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型

Stable Diffusion Ncnn ⭐ 701

Stable Diffusion in NCNN with c++, supported txt2img and img2img

Adlik: Toolkit for Accelerating Deep Learning Inference

Tensorrt For Yolo Series ⭐ 636

tensorrt for yolo series (YOLOv8, YOLOv7, YOLOv6....), nms plugin support

Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.

Forward ⭐ 491

A library for high performance deep learning inference on NVIDIA GPUs.

Tensorrt Yolov3 ⭐ 375

TensorRT for Yolov3

Tensorrt ⭐ 370

TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等可训练自己数据

Tensorrt Cpp Api ⭐ 354

TensorRT C++ API Tutorial

Deepstream_tao_apps ⭐ 323

Sample apps to demonstrate how to deploy models trained with TAO on DeepStream

Yolov8 Tensorrt Cpp ⭐ 306

YOLOv8 TensorRT C++ Implementation

Nndeploy ⭐ 303

nndeploy is a cross-platform, high-performing, and straightforward AI model deployment framework. We strive to deliver a consistent and user-friendly experience across various inference framework backends in complex deployment environments and focus on performance.

Deepstream_pose_estimation ⭐ 210

This is a sample DeepStream application to demonstrate a human pose estimation pipeline.

Yolox Ros ⭐ 209

YOLOX + ROS2 object detection package (C++ only support)

Tensorrt Laboratory ⭐ 193

Explore the Capabilities of the TensorRT Platform

Vs Mlrt ⭐ 189

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

Yolov4 Triton Tensorrt ⭐ 184

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server

Self Driving Ish_computer_vision_system ⭐ 181

This project generates images you've probably seen in autonomous driving demo. Object Detection, Lane Detection, Road Segmentation, Depth Estimation using TensorRT

Mobilenet Ssd Tensorrt ⭐ 176

Accelerate mobileNet-ssd with tensorRT

Retinaface ⭐ 171

Reimplement RetinaFace use C++ and TensorRT

Facealgorithm ⭐ 147

face detection face recognition包含人脸检测(retinaface,yolov5face,yolov7face

Ros Yolo Sort ⭐ 144

YOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)

Centernet Tensorrt ⭐ 143

This is a C++ implementation of CenterNet using TensorRT and CUDA

Feature Detection Matching Algorithm ⭐ 130

🚀 Deep learning includes superpoint-superglue(C++, TensorRT), and traditional algorithms include zkaze, surf, ORB, etc.

Libdeepvac ⭐ 122

Use PyTorch model in C++ project

Inferencehelper ⭐ 119

C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow

Amirstan_plugin ⭐ 114

Useful tensorrt plugin. For pytorch and mmdetection model conversion.

Superpoint Superglue Tensorrt ⭐ 113

SuperPoint and SuperGlue with TensorRT. Deploy with C++.

Fast Pathology ⭐ 108

⚡ Open-source software for deep learning-based digital pathology

Etagger ⭐ 103

reference tensorflow code for named entity tagging

Play_with_tensorrt ⭐ 101

Sample projects for TensorRT in C++

Yolov5 Deepsort Tensorrt ⭐ 94

A c++ implementation of yolov5 and deepsort

Torchpipe ⭐ 91

Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends

Isaac_ros_dnn_inference ⭐ 88

Hardware-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU

Yolo Tensorrt Gie ⭐ 85

This code is an implementation of a trained YOLO neural network used with the TensorRT framework.

Isaac_ros_pose_estimation ⭐ 70

Deep learned, hardware-accelerated 3D object pose estimation

基于TensorRT的C++高性能推理库，YOLOPv2，Yolov5/7/X/8，RT-DETR，

Tensorrtwrapper ⭐ 64

TensorRT Net Wrapper

Tensorrt_inference_demo ⭐ 59

A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.

Isaac_ros_object_detection ⭐ 52

Hardware-accelerated, deep learned model support for object detection including YOLOv8 and DetectNet

Yolov5_tensorrt_win10 ⭐ 48

A simple implementation of tensorrt yolov5 python/c++🔥

Keras Tensorrt Jetson ⭐ 47

Example of loading a Keras model into TensorRT C++ API

Easy-to-Use C++ Computer Vision Library

Yolov5_tensorrt_int8 ⭐ 44

TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！

Isaac_ros_image_segmentation ⭐ 40

Hardware-accelerated, deep learned semantic image segmentation

Object Detection And Location Realsensed435 ⭐ 39

Use the Intel D435 real-sensing camera to realize target detection based on the Yolov3 framework under the Opencv DNN framework, and realize the 3D positioning of the Objection according to the depth information. Real-time display of the coordinates in the camera coordinate system.ADD--Using Yolov5 By TensorRT model,AGX-Xavier,RealTime Object Detection

Object Detection Inference ⭐ 37

C++ object detection inference from video or image input source

Tensorrt Openpose ⭐ 36

TensorRT C++ Implementation of openpose

Cheetahinfer ⭐ 33

A C++ inference SDK based on TensorRT

Tensorrt_seg_lw_refinenet ⭐ 32

一个简单的TensorRT实现语义分割的C++程序

Chainer Trt ⭐ 31

Chainer x TensorRT

Tensorflow Tensorrt ⭐ 30

Tensorflow to TensorRT Model Converter

Yolov5_jde_tensorrt_for_track ⭐ 27

A multi object tracking Library Based on tensorrt

Nvidia Deepstreamsdk ⭐ 26

NVIDIA DeepStream SDK

Rangenettrt8 ⭐ 26

tensorrt8 && cuda && libtorch implementation of rangenet++

Tensorrt Yolov8 Bytetrack ⭐ 24

An object tracking project with YOLOv8 and ByteTrack, speed up by C++ and TensorRT.

Person Detection ⭐ 23

TensorRT person tracking RFBNet300

Pointcloud 3d Detector Tensorrt ⭐ 23

The first tensorrt implementation for point-based 3d detector, i.e., 3DSSD,SASA,IA-SSD.

Depth Anything Tensorrt ⭐ 23

tensorrt cpp implementation of depth-anything model

Ros Object Detection 2dto3d Realsensed435 ⭐ 22

Use the Intel D435 real-sensing camera to realize object detection based on the Yolov3-5 framework under the Opencv DNN(old version)/TersorRT(now) by ROS-melodic.Real-time display of the Pointcloud in the camera coordinate system.

Face Recognition Cpp Tensorrt ⭐ 21

Face Recognition with RetinaFace and ArcFace.

Nanodet_tensorrt_int8 ⭐ 19

nanodet int8 量化，实测推理2ms一帧！

Mediapipe_plus ⭐ 16

The purpose of this project is to apply mediapipe to more AI chips.

Tensorrt Yolov6 ⭐ 15

C++ implementation of YOLOv6 using TensorRT

Mobilenetv1 Ssd Tensorrt ⭐ 15

Got 100fps on TX2. Got 1000fps on GeForce GTX 1660 Ti. Implement mobilenetv1-ssd-tensorrt layer by layer using TensorRT API. If the project is useful to you, please Star it.

Tensorrt Lpr ⭐ 14

车牌识别，基于HyperLPR实现，修改模型调用方法，使用caffe+tensorRT实现GPU加速

Tensorrt Image Classification ⭐ 13

Windows - C++ Visual Studio solution for Image Classification using Caffe Model and TensorRT inference platform

Common Image Segmentation Algorithm ⭐ 13

🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.

Mxnet2caffe Tensor Rt Senet ⭐ 13

Mxnet2Caffe_Tensor RT

Image Animation Turbo Boost ⭐ 13

Aim to accelerate the image-animation-model inference through the inference frameworks such as onnx、tensorrt and openvino.

Jetson_tensorrt ⭐ 12

ROS TensorRT Inference Nodes for DIGITS on the Jetson

Nanosam Cpp ⭐ 11

C++ TensorRT Implementation of NanoSAM

Deepsort Tensorrt ⭐ 10

A C++ implementation of Deepsort in Jetson Xavier nx and Jetson nano

Yolov5 Tensorrt ⭐ 9

Real-time object detection with YOLOv5 and TensorRT

Go Tensorrt ⭐ 9

Go binding to TensorRT C API to do inference with pre-trained model in Go

Yolov4 Deepstream ⭐ 9

YOLOv4 accelerated wtih TensorRT and multi-stream input using Deepstream

Yolo Object Tracking ⭐ 8

Real-time implementation of computer vision algorithms

Sam_tensorrt ⭐ 8

This is the code to implement Segment Anything (SAM) using TensorRT(C++).

Tkdnn Ros ⭐ 8

(ROS) YOLOv3, v4, v7 detection + Shelfnet semantic segmentation with TensorRT, utilizing tkDNN

Unet Tensorrt ⭐ 7

this is a tensorrt version unet, inspired by tensorrtx

Inferencehelper_sample ⭐ 7

Sample projects for InferenceHelper, a Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow

Yolov8tensorrtros ⭐ 7

The ROS warper for yolov8 with tensorrt acceleration

Fast_segmentation ⭐ 7

GPU and CPU examples for semantic segmentation using Tensorflow and with ROS support

Track Trt ⭐ 7

基于 TensorRT 的 C++ 高性能单目标跟踪推理，支持算法OSTrack、LightTrack。

Yolov5_bytetrack_multithreading_tensorrt ⭐ 7

Multi-thread tracking of YOLOv5 and ByteTrack implemented by C++, accelerated by TensorRT. YOLOv5 和 ByteTrack 的多线程追踪 C++ 实现, 使用 TensorRT 进行推理加速

Ultraface_tensorrt_cpp ⭐ 7

超轻量化模型的UltraFace tensorrt部署 ,详细注释

Keypoints ⭐ 6

Keypoints-detection in tensorflow and tensorRT C++

Fp Dsa Plugin ⭐ 5

Digital Slide Archive plugin to enable FAST deployment of pretrained CNNs for digital pathology

Alexnetrt ⭐ 5

A simple AlexNet deployment using TensorRT.

Related Searches

C Plus Plus Cmake (8,640)

C Plus Plus Qt (8,557)

C Plus Plus Video Game (8,255)

Python C Plus Plus (6,252)

C Plus Plus Algorithms (6,194)

C Plus Plus Opengl (4,396)

C Plus Plus 3d Graphics (3,196)

C Plus Plus Testing (2,735)

Java C Plus Plus (2,629)

C Plus Plus Command Line (2,304)

1-94 of 94 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.