Awesome Open Source

Programming Languages

Search results for pytorch onnxruntime

42 search results found

An Engine-Agnostic Deep Learning Framework in Java

Mmdeploy ⭐ 2,371

OpenMMLab Model Deployment Framework

Yolov5 Lite ⭐ 1,975

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

Optimum ⭐ 1,908

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Openseeface ⭐ 1,252

Robust realtime face and facial landmark tracking on CPU with Unity integration

Moevoicestudio ⭐ 846

一个使用C++编写的音频处理软件

Redisai ⭐ 799

A Redis module for serving tensors and executing deep learning graphs

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

X Stable Diffusion ⭐ 523

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Lightglue Onnx ⭐ 141

ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO

Optimum Benchmark ⭐ 140

A unified multi-backend utility for benchmarking Transformers and Diffusers with support for Optimum's arsenal of hardware optimizations/quantization schemes.

Clip Onnx ⭐ 122

It is a simple library to speed up CLIP inference up to 3x (K80 GPU)

Vehicle Cv Adas ⭐ 85

The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv8 and Ultra-Fast-Lane-Detection-v2 .

Mmdetection ⭐ 81

OpenVINO Training Extensions Object Detection

Video Transformers ⭐ 67

Easiest way of fine-tuning HuggingFace video classification models

Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.

Nn Inference Template ⭐ 63

Neural network inference template for real-time cricital audio environments - presented at ADC23

Onnx Facial Lmk Detector ⭐ 43

End-to-end face detection, cropping, norm estimation, and landmark detection in a single onnx model

Setup Deeplearning Tools ⭐ 41

Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.

Iclassifier ⭐ 40

reference pytorch code for intent classification

Pytorch Onnx Tensorrt ⭐ 35

A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3

Deep Object Reid ⭐ 31

OpenVINO Training Extensions Object Re-identification

Infery Examples ⭐ 28

A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).

Onnx_clip ⭐ 27

An ONNX-based implementation of the CLIP model that doesn't depend on torch or torchvision.

Yolo Nas Onnxruntime ⭐ 22

This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/float16/int8 inference.

Dl Benchmark ⭐ 21

Deep Learning Inference benchmark. Supports Intel® Distribution of OpenVINO™ Toolkit, Caffe, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch and Apache TVM

Dnn Bench ⭐ 19

A library that lets you easily increase efficiency of your deep learning models with no loss of accuracy.

Dedode Onnx Tensorrt ⭐ 17

ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀

Onnxruntime_flutter ⭐ 16

Flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.

Fast Seamlessm4t Onnx ⭐ 16

ONNX-compatible Fast SeamlessM4T—Massively Multilingual & Multimodal Machine Translation

Hand Gesture Recognition Using Onnx ⭐ 14

This is a hand gesture recognition program that replaces the entire MediaPipe process with ONNX. Simultaneous detection of multiple palms and a simple tracker are additionally implemented. In addition, a simple MLP can learn and recognize gestures.

Export_llama_to_onnx ⭐ 14

export llama to onnx

Jredisai ⭐ 13

Java client for RedisAI

Depth Anything Onnx ⭐ 13

ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

Speech Command Recognition ⭐ 13

Classify input audio segment into categories for keyword spotting with MatchboxNet with training, exporting onnx model, accelerating inference via TensorRT

Nanodet Colaboratory Training Sample ⭐ 12

NanoDetをGoogle Colaboratory上で訓練しONNX形式のファイルをエクスポートするサンプル(This is a sample to training NanoDet on Google Colaboratory and export a file in ONNX format)

Ampere_model_library ⭐ 11

Ampere Model Library - AML

Tensorrt Experiment ⭐ 10

Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.

Pytorch_infer_utils ⭐ 9

This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.

Simple_cnn ⭐ 9

Simple CNN is a library that can be used to train and infer CNN models by use of PyTorch and ONNX.

ONNX Model Exporter for TensorLayerX

Train Pytorch In Js ⭐ 8

Convert a PyTorch model and train it in JavaScript in your browser using ONNX Runtime Web

Transformers_onnx ⭐ 7

Flink Onnx Pytorch ⭐ 5

Streaming machine learning using PyTorch, Flink, and ONNX

Related Searches

Python Pytorch (15,943)

Deep Learning Pytorch (7,533)

Jupyter Notebook Pytorch (4,892)

Machine Learning Pytorch (2,934)

Dataset Pytorch (1,848)

Pytorch Convolutional Neural Networks (1,777)

Pytorch Neural Network (1,631)

Pytorch Natural Language Processing (1,408)

Pytorch Computer Vision (1,230)

Pytorch Neural (1,217)

1-42 of 42 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.