Awesome Open Source

Programming Languages

Search results for onnx onnxruntime

115 search results found

Lite.ai.toolkit ⭐ 3,319

🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOv5, YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv8. MNN, NCNN, TNN, ONNXRuntime.

Fastdeploy ⭐ 2,547

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Mmdeploy ⭐ 2,371

OpenMMLab Model Deployment Framework

Obs Backgroundremoval ⭐ 2,269

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Optimum ⭐ 1,908

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Openseeface ⭐ 1,252

Robust realtime face and facial landmark tracking on CPU with Unity integration

Hcaptcha Challenger ⭐ 1,247

🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Paddle2onnx ⭐ 584

ONNX Model Exporter for PaddlePaddle

X Stable Diffusion ⭐ 523

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.

A Rust wrapper for ONNX Runtime

Image Processing Node Editor ⭐ 404

処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Unpaint ⭐ 224

A simple Windows / Xbox app for generating AI images with Stable Diffusion.

Refacer ⭐ 223

Refacer: One-Click Deepfake Multi-Face Swap Tool

Browser Ml Inference ⭐ 221

Edge Inference in Browser with Transformer NLP model

Onnxruntime Rs ⭐ 220

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

Onnx Yolov8 Object Detection ⭐ 209

Python scripts performing object detection using the YOLOv8 model in ONNX.

Llama.onnx ⭐ 196

LLaMa/RWKV onnx models, quantization and testcase

Vs Mlrt ⭐ 189

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

Onnx_runtime_cpp ⭐ 176

small c++ library to quickly deploy models using onnxruntime

Stablediffusion ⭐ 158

Inference Stable Diffusion with C# and ONNX Runtime

Diffusers ⭐ 145

A modular Rust library for super fast Stable Diffusion inference - 45% faster than PyTorch 🔮

Lightglue Onnx ⭐ 141

ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO

Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.

Clip Onnx ⭐ 122

It is a simple library to speed up CLIP inference up to 3x (K80 GPU)

Onnxruntime Silicon ⭐ 107

ONNX Runtime prebuilt wheels for Apple Silicon (M1 / M2 / M3 / ARM64)

Faceonnx ⭐ 105

Face recognition and analytics library based on deep neural networks and ONNX runtime

Onnxruntime_backend ⭐ 103

The Triton backend for the ONNX Runtime.

Rvm Inference ⭐ 100

🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.

Use YOLOv8 in real-time, for object detection, instance segmentation, pose estimation and image classification, via ONNX Runtime.

ONNX DART LIBRARY

Onnx Mobile Human Pose 3d ⭐ 92

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Gst Inference ⭐ 86

A GStreamer Deep Learning Inference Framework

Mmdetection ⭐ 81

OpenVINO Training Extensions Object Detection

Onnxruntime_go ⭐ 81

A Go (golang) library wrapping microsoft/onnxruntime.

Onnxruntime Projects ⭐ 79

Code for some onnxruntime projects

Optimum Transformers ⭐ 71

Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.

ONNX Runtime bindings for Elixir

Onnxruntime Server ⭐ 69

ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.

Video Transformers ⭐ 67

Easiest way of fine-tuning HuggingFace video classification models

Nn Inference Template ⭐ 63

Neural network inference template for real-time cricital audio environments - presented at ADC23

ONNX runtime for Flutter.

Livechess2fen ⭐ 57

Predict live chess games into FEN notation.

Vitsserver ⭐ 52

🌻 A VITS ONNX server designed for fast inference 🔥

Yolo Nas Onnx ⭐ 51

Inference YOLO-NAS ONNX model

Onnx_transformers ⭐ 49

Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.

Onnx Facial Lmk Detector ⭐ 43

End-to-end face detection, cropping, norm estimation, and landmark detection in a single onnx model

Iclassifier ⭐ 40

reference pytorch code for intent classification

pg_onnx: ONNX Runtime integrated with PostgreSQL. Perform ML inference with data in your database.

Onnx Ultra Fast Lane Detection Inference ⭐ 35

Example scripts for the detection of lanes using the ultra fast lane detection model in ONNX.

Onnxruntime.jl ⭐ 35

Julia bindings for onnxruntime

Pytorch Onnx Tensorrt ⭐ 35

A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3

Buildseg ⭐ 35

buildseg is a building extraction plugin of QGIS based on ONNX『buildseg是一个基于ONNX的用于建筑提取的QGIS插件』

Efficientnet Lite Keras ⭐ 32

Keras reimplementation of EfficientNet Lite.

Deep Object Reid ⭐ 31

OpenVINO Training Extensions Object Re-identification

Ml Edge Getting Started ⭐ 29

Infery Examples ⭐ 28

A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).

.NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within the .NET eco-system

Onnx_clip ⭐ 27

An ONNX-based implementation of the CLIP model that doesn't depend on torch or torchvision.

Ort Builder ⭐ 27

ONNX Runtime static library builder

Yolov5 Onnxruntime ⭐ 27

YOLOv5 ONNX Runtime C++ inference code.

Distributed Inference ⭐ 26

A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.

Tonnxruntime ⭐ 25

TOnnxRuntime is a Microsoft ONNXRuntime AI and Machine Learning Library for Freepascal / Delphi

Allegro Music Transformer ⭐ 24

Full-attention multi-instrumental music transformer featuring asymmetrical encoding with octo-velocity, and chords counters tokens, optimized for speed and performance

Onnx Crestereo Depth Estimation ⭐ 23

Python scripts performing stereo depth estimation using the CREStereo model in ONNX.

Onnx Hitnet Stereo Depth Estimation ⭐ 21

Python scripts form performing stereo depth estimation using the HITNET model in ONNX.

Onnx Runtime With Tensorrt And Openvino ⭐ 21

Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment

Model Inference Deployment ⭐ 21

A curated list of awesome inference deployment framework of artificial intelligence models.

Ros_msft_onnx ⭐ 20

ONNX Runtime for the Robot Operating System (ROS), works on ROS1 and ROS2

Onnx Mobilestereonet ⭐ 20

Python scripts for performing stereo depth estimation using the MobileStereoNet model in ONNX

Webai.js ⭐ 18

A simple Web AI model deployment tool using JavaScript based on OpenCV.js and ONNXRuntime

Onnx Yolov8 Instance Segmentation ⭐ 18

Python scripts performing Instance Segmentation using the YOLOv8 model in ONNX.

Sardonyx ⭐ 18

Convert your ONNX models into Swift for TensorFlow or Metal Performance Shaders (WIP)

Onnx Centersnap 6d Pose And Shape Estimation ⭐ 17

Python scripts for performing 6D pose estimation and shape reconstruction using the CenterSnap model in ONNX

Sit4onnx ⭐ 17

Tools for simple inference testing using TensorRT, CUDA and OpenVINO CPU/GPU and CPU providers. Simple Inference Test for ONNX.

Caffe2onnx ⭐ 17

Convert Caffe models to ONNX.

Dedode Onnx Tensorrt ⭐ 17

ONNX-compatible DeDoDe 🎶 Detect, Don't Describe - Describe, Don't Detect, for Local Feature Matching. Supports TensorRT 🚀

Mid-Level Rust Bindings to the C API for Microsoft's ONNX Runtime

Onnxruntime_flutter ⭐ 16

Flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.

Fast Seamlessm4t Onnx ⭐ 16

ONNX-compatible Fast SeamlessM4T—Massively Multilingual & Multimodal Machine Translation

Yet another ssd, with its runtime stack for libtorch, onnx and specialized accelerators.

Yolodotnet ⭐ 15

YoloDotNet is a C# .NET 8.0 implementation of Yolov8 and ONNX runtime with CUDA

Export_llama_to_onnx ⭐ 14

export llama to onnx

Hand Gesture Recognition Using Onnx ⭐ 14

This is a hand gesture recognition program that replaces the entire MediaPipe process with ONNX. Simultaneous detection of multiple palms and a simple tracker are additionally implemented. In addition, a simple MLP can learn and recognize gestures.

Yolov7 Onnxruntime Web ⭐ 14

YOLOv7 right in your browser with onnxruntime-web

Onnx Hybridnets Multitask Road Detection ⭐ 14

Python scripts for performing road segemtnation and car detection using the HybridNets multitask model in ONNX.

Depth Anything Onnx ⭐ 13

ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

Onnx Scdepth Monocular Depth Estimation ⭐ 13

Python scripts for performing monocular depth estimation using the SC_Depth model in ONNX

Onnxruntime Node Gpu ⭐ 13

Drop-in replacement for onnxruntime-node with GPU support using CUDA or DirectML

Onnx Extended ⭐ 13

New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA

Nanodet Colaboratory Training Sample ⭐ 12

NanoDetをGoogle Colaboratory上で訓練しONNX形式のファイルをエクスポートするサンプル(This is a sample to training NanoDet on Google Colaboratory and export a file in ONNX format)

Onnx Stable Diffusion Modularui ⭐ 12

An approach to make a more modular UI for ONNX Stable Diffusion, to ease future upgrades

Onnxruntime Java ⭐ 11

EXPERIMENTAL: A type-safe, lightweight, and performant binding Java binding of Microsoft's ONNX Runtime

Faceaisharp ⭐ 11

State-of-the-art face detection and face recognition for .NET.

Semi Automatic Anno ⭐ 10

Implementation of some model inference based on onnxruntime using python

Onnx Glpdepth ⭐ 10

Python scripts for performing monocular depth estimation using the GLPDepth model in ONNX

Onnxruntimedirectmlepsample ⭐ 10

Little console app to run an ONNX model through ONNX Runtime via the DirectML execution provider.

Efficientnet V2 Keras ⭐ 10

Efficientnet V2 adapted to Keras functional API.

Super Resolution Js ⭐ 10

SOTA image super-resolution in JavaScript/Wasm using an ONNX-ported SwinIR model

Related Searches

Python Onnx (378)

Pytorch Onnx (248)

1-100 of 115 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.