Awesome Open Source

Programming Languages

Search results for pytorch tensorrt

96 search results found

Yolox ⭐ 8,759

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

Tensorrtx ⭐ 6,315

Implementation of popular deep learning networks with TensorRT network definition API

Tengine ⭐ 4,452

Tengine is a lite, high performance, modular inference engine for embedded device

Pytorch Yolov4 ⭐ 4,340

PyTorch ,ONNX and TensorRT implementation of YOLOv4

Torch2trt ⭐ 4,267

An easy to use PyTorch to TensorRT converter

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

Damo Yolo ⭐ 3,598

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

Deepdetect ⭐ 2,492

Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Tensorrt_pro ⭐ 2,411

C++ library based on tensorrt integration

Mmdeploy ⭐ 2,371

OpenMMLab Model Deployment Framework

Tensorrt ⭐ 2,308

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Micronet ⭐ 2,177

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/in

Yolov5 Lite ⭐ 1,975

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Yolov5 Face ⭐ 1,791

YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)

Deepstream Yolo ⭐ 1,184

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models

Bisenet ⭐ 1,130

Add bisenetv2. My implementation of BiSeNet

Trt_pose ⭐ 763

Real-time pose estimation accelerated with NVIDIA TensorRT

Retinanet Examples ⭐ 727

Fast and accurate object detection with end-to-end GPU optimization

Pytorch Auto Drive ⭐ 713

PytorchAutoDrive: Segmentation models (ERFNet, ENet, DeepLab, FCN...) and Lane detection models (SCNN, RESA, LSTR, LaneATT, BézierLaneNet...) based on PyTorch with fast training, visualization, benchmarking & deployment help

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Deepvac ⭐ 618

PyTorch Project Specification.

Flexible Yolov5 ⭐ 607

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

Fasterseg ⭐ 523

[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang

X Stable Diffusion ⭐ 523

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

Forward ⭐ 491

A library for high performance deep learning inference on NVIDIA GPUs.

Jetson Nano Ubuntu 20 Image ⭐ 382

Jetson Nano with Ubuntu 20.04 image

Edgeyolo ⭐ 350

an edge-real-time anchor-free object detector with decent performance

Pytorch Tutorial 2nd ⭐ 266

《Pytorch实用教程——第二版》无论是零基础入门，还是进阶工程化部署落地，在这里都有。相信在本书 PyTorch 的使用，成为一名优秀的深度学习工程师。

Openvino2tensorflow ⭐ 262

This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and pb. PyTorch (NCHW) -> ONNX (NCHW) -> OpenVINO (NCHW) -> openvino2tensorflow -> Tensorflow/Keras (NHWC/NCHW) -> TFLite (NHWC/NCHW). And the conversion from .pb to saved_model and from saved_model to .pb and from .pb to .tflite and saved_model to .tflite and saved_model to onnx. Support for building environments with Docker. It is possible to directly access the

Volksdep ⭐ 214

volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.

Lightglue Onnx ⭐ 141

ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO

Torch Model Compression ⭐ 137

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

Ml Model Ci ⭐ 135

MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.

Libdeepvac ⭐ 122

Use PyTorch model in C++ project

Amirstan_plugin ⭐ 114

Useful tensorrt plugin. For pytorch and mmdetection model conversion.

Pytorch_onnx_tensorrt ⭐ 112

A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX

Mutualguide ⭐ 111

Localize to Classify and Classify to Localize: Mutual Guidance in Object Detection

Fast Pathology ⭐ 108

⚡ Open-source software for deep learning-based digital pathology

Tensorrt_yolo3 ⭐ 102

use TensorRT accelerate yolo3

Collection of Docker images for ML/DL and video processing projects

Deepstream Yolo Pose ⭐ 93

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 application for YOLO-Pose models

Torchpipe ⭐ 91

Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends

Nutonomy_pointpillars ⭐ 88

Convert pointpillars Pytorch Model To ONNX for TensorRT Inference

Vehicle Cv Adas ⭐ 85

The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv8 and Ultra-Fast-Lane-Detection-v2 .

RIFE function for VapourSynth

Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.

Torch2trt ⭐ 60

convert torch module to tensorrt network or tvm function

Flexinfer ⭐ 55

A flexible Python front-end inference SDK based on TensorRT

Vs Realesrgan ⭐ 53

Real-ESRGAN function for VapourSynth

Ai_basketball_games_video_editor ⭐ 51

AI Basketball Games Video Editor is a program to get basketball highlight video by PyTorch YOLOv4 object detection

Stable Diffusion Tritonserver ⭐ 49

Deploy stable diffusion model with onnx/tenorrt + tritonserver

Tensorrt_yolo3_module ⭐ 47

You can import this module directly

Computer Vision Container ⭐ 46

This container is no longer supported, and has been deprecated in favor of: https://github.com/joehoeller/NVIDIA-GPU-Tensor-Co

This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥

Setup Deeplearning Tools ⭐ 41

Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.

Jetson Voice ⭐ 39

ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT

Tensorrt Cv ⭐ 38

Using TensorRT for Inference Model Deployment.

Opti_models ⭐ 38

PyTorch optimizations and benchmarking

Pytorch Onnx Tensorrt ⭐ 35

A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3

Turnkeyml ⭐ 34

The AI insights toolchain

Cheetahinfer ⭐ 33

A C++ inference SDK based on TensorRT

Tensorrt_seg_lw_refinenet ⭐ 32

一个简单的TensorRT实现语义分割的C++程序

DPIR function for VapourSynth

Infery Examples ⭐ 28

A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).

Tensorrt_scatter ⭐ 25

TensorRT Plugin of corresponding PyTorch Scatter operators.

Yolox Bytetrack Car Counter ⭐ 25

Car tracking and car counter implemented with YOLOX, ByteTrack and Pytorch.

Trt_pose_hand ⭐ 24

Real-time hand pose estimation and gesture classification using TensorRT

Person Detection ⭐ 23

TensorRT person tracking RFBNet300

Deephawkeye ⭐ 22

image anomaly detection

Benchmarks ⭐ 21

TensorFlow, TensorFlow-Lite Pytorch, Torchvision, TensorRT Benchmarks

Pytorch Tensorrt Plugins ⭐ 19

Useful plugins for Pytorch1.5+ and TensorRT7/8.

Vs Gmfss_union ⭐ 18

GMFSS_union function for VapourSynth

Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.

Dedode Onnx Tensorrt ⭐ 17

ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀

Mobilenetv1 Ssd Tensorrt ⭐ 15

Got 100fps on TX2. Got 1000fps on GeForce GTX 1660 Ti. Implement mobilenetv1-ssd-tensorrt layer by layer using TensorRT API. If the project is useful to you, please Star it.

Sharkshark 4k ⭐ 14

Upscale Twitch stream and restream into Twitch or RTMP or File.

Onnx2tensorrt ⭐ 14

tensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version

Darklight ⭐ 13

A framework for knowledge distillation using TensorRT inference on teacher network

Deepstream Yolo Seg ⭐ 13

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 implementation for YOLO-Segmentation models

Onnx Model Zoo ⭐ 13

This GitHub repository contains converted models in ONNX, TensorRT, and PyTorch formats, along with inference scripts and demos. These models can be used for efficient deployment and inference in machine learning applications.

Netspresso Trainer ⭐ 13

A library for training, compressing and deploying computer vision models (including ViT) with edge devices

Yolov5_tensorrt ⭐ 13

This is the implementation that supports yolov5s, yolov5m, yolov5l, yolov5x.

Convert Pytorch Onnx Tensorrt ⭐ 12

Converting weights of Pytorch models to ONNX & TensorRT engines

Tensorrt_ex ⭐ 11

Deep Learning Model Optimization Using by TensorRT API, window

Tensorrt Experiment ⭐ 10

Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.

convert a pytorch model to a model for edge device

Deepstream Yolo Face ⭐ 9

NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 application for YOLO-Face models

Pytorch_infer_utils ⭐ 9

This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.

Tensorrt Deformable Detr ⭐ 8

Tensorrt-Deformable-Detr

Ssdf Nncore ⭐ 7

nncore is a pytorch framework focusing on solving autonomous-driving problems.

Model Optimizer ⭐ 7

各类深度模型的优化器，包括tvm、tf-tensorrt、tensorrt等。

Vitpose Pytorch ⭐ 7

VitPose without MMCV dependencies

Centernet Onnx Tensorrt ⭐ 6

centernet to onnx and to tensorrt

Vs Animesr ⭐ 6

AnimeSR function for VapourSynth

License Plate Recognition System ⭐ 5

Real Time License Plate Recognition System with YOLOv3

Real Time 3d Multi Person Pose Estimation Demo On Jetson Tx2 ⭐ 5

Real-time 3D multi-person pose estimation demo on Jetson TX2 with TensorRT.

Related Searches

Python Pytorch (14,671)

Deep Learning Pytorch (7,533)

Jupyter Notebook Pytorch (4,892)

Machine Learning Pytorch (2,934)

Dataset Pytorch (1,858)

Pytorch Convolutional Neural Networks (1,572)

Pytorch Natural Language Processing (1,408)

Pytorch Neural Network (1,391)

Tensorflow Pytorch (1,313)

Pytorch Computer Vision (1,298)

1-96 of 96 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.