Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for onnxruntime
onnxruntime
x
191 search results found
Djl
⭐
3,708
An Engine-Agnostic Deep Learning Framework in Java
Lite.ai.toolkit
⭐
3,319
🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOv5, YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv8. MNN, NCNN, TNN, ONNXRuntime.
Fastdeploy
⭐
2,547
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
Mmdeploy
⭐
2,371
OpenMMLab Model Deployment Framework
Obs Backgroundremoval
⭐
2,269
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.
Yolov5 Lite
⭐
1,975
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
Optimum
⭐
1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
Nudenet
⭐
1,552
Lightweight nudity detection
Rapidocr
⭐
1,551
A cross platform OCR Library based on PaddleOCR & OnnxRuntime & OpenVINO.
Openseeface
⭐
1,252
Robust realtime face and facial landmark tracking on CPU with Unity integration
Hcaptcha Challenger
⭐
1,247
🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.
Head Pose Estimation
⭐
1,024
Realtime human head pose estimation with ONNXRuntime and OpenCV.
Moevoicestudio
⭐
846
一个使用C++编写的音频处理软件
Redisai
⭐
799
A Redis module for serving tensors and executing deep learning graphs
Yolort
⭐
705
yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
Paddle2onnx
⭐
584
ONNX Model Exporter for PaddlePaddle
X Stable Diffusion
⭐
523
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention.
Ort
⭐
413
A Rust wrapper for ONNX Runtime
Image Processing Node Editor
⭐
404
処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)
Nndeploy
⭐
303
nndeploy is a cross-platform, high-performing, and straightforward AI model deployment framework. We strive to deliver a consistent and user-friendly experience across various inference framework backends in complex deployment environments and focus on performance.
Fastt5
⭐
280
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Unpaint
⭐
224
A simple Windows / Xbox app for generating AI images with Stable Diffusion.
Refacer
⭐
223
Refacer: One-Click Deepfake Multi-Face Swap Tool
Browser Ml Inference
⭐
221
Edge Inference in Browser with Transformer NLP model
Onnxruntime Rs
⭐
220
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
Onnx Yolov8 Object Detection
⭐
209
Python scripts performing object detection using the YOLOv8 model in ONNX.
Yolox Ros
⭐
209
YOLOX + ROS2 object detection package (C++ only support)
Llama.onnx
⭐
196
LLaMa/RWKV onnx models, quantization and testcase
Vs Mlrt
⭐
189
Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)
Onnx_runtime_cpp
⭐
176
small c++ library to quickly deploy models using onnxruntime
Rapidlatexocr
⭐
162
Convert images of formula into LaTeX code based on ONNXRuntime.
Stablediffusion
⭐
158
Inference Stable Diffusion with C# and ONNX Runtime
Diffusers
⭐
145
A modular Rust library for super fast Stable Diffusion inference - 45% faster than PyTorch 🔮
Lightglue Onnx
⭐
141
ONNX-compatible LightGlue: Local Feature Matching at Light Speed. Supports TensorRT, OpenVINO
Optimum Benchmark
⭐
140
A unified multi-backend utility for benchmarking Transformers and Diffusers with support for Optimum's arsenal of hardware optimizations/quantization schemes.
Onnxt5
⭐
136
Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
Yolov5 Seg Opencv Onnxruntime Cpp
⭐
126
yolov5 segmentation with onnxruntime and opencv
Clip Onnx
⭐
122
It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
Sd4j
⭐
120
Stable diffusion pipeline in Java using ONNX Runtime
Yolo Streaming
⭐
119
Push-pull streaming and Web display of YOLO series
Onnxruntime Silicon
⭐
107
ONNX Runtime prebuilt wheels for Apple Silicon (M1 / M2 / M3 / ARM64)
Faceonnx
⭐
105
Face recognition and analytics library based on deep neural networks and ONNX runtime
Onnxruntime_backend
⭐
103
The Triton backend for the ONNX Runtime.
Onnxstack
⭐
102
C# Stable Diffusion using ONNX Runtime
Rvm Inference
⭐
100
🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.
Yolov8
⭐
98
Use YOLOv8 in real-time, for object detection, instance segmentation, pose estimation and image classification, via ONNX Runtime.
Onnx
⭐
94
ONNX DART LIBRARY
Onnx Mobile Human Pose 3d
⭐
92
Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.
Gst Inference
⭐
86
A GStreamer Deep Learning Inference Framework
Vehicle Cv Adas
⭐
85
The project can achieve FCWS, LDWS, and LKAS functions solely using only visual sensors. using YOLOv5 / YOLOv5-lite / YOLOv8 and Ultra-Fast-Lane-Detection-v2 .
Onnxruntime_go
⭐
81
A Go (golang) library wrapping microsoft/onnxruntime.
Mmdetection
⭐
81
OpenVINO Training Extensions Object Detection
Onnxruntime Projects
⭐
79
Code for some onnxruntime projects
Ntts
⭐
74
Neural Text To Speech Di Dart Cepat Ringan Tanpa Koneksi Internet dan bisa berjalan di cpu
Optimum Transformers
⭐
71
Accelerated NLP pipelines for fast inference on CPU and GPU. Built with Transformers, Optimum and ONNX Runtime.
Ortex
⭐
70
ONNX Runtime bindings for Elixir
Onnxruntime Server
⭐
69
ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.
Video Transformers
⭐
67
Easiest way of fine-tuning HuggingFace video classification models
Cvu
⭐
64
Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platforms, devices, and models.
Nn Inference Template
⭐
63
Neural network inference template for real-time cricital audio environments - presented at ADC23
Ocrliteonnx
⭐
63
chineseocr lite onnx,超轻量级中文ocr demo,支持onnx推理 ( dbnet+crnn+anglenet)
Fonnx
⭐
61
ONNX runtime for Flutter.
Livechess2fen
⭐
57
Predict live chess games into FEN notation.
Vitsserver
⭐
52
🌻 A VITS ONNX server designed for fast inference 🔥
Yolo Nas Onnx
⭐
51
Inference YOLO-NAS ONNX model
Face Recognition Sdk Javascript
⭐
51
Face Recognition Javascript SDK using ONNX Runtime Web and OpenCV.js (Face Detection, Face Landmarks, Face Liveness, Face Pose, Face Expression, Eye Closeness, Age, Gender and Face Recognition)
Onnx_transformers
⭐
49
Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.
Onnx Facial Lmk Detector
⭐
43
End-to-end face detection, cropping, norm estimation, and landmark detection in a single onnx model
Setup Deeplearning Tools
⭐
41
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Iclassifier
⭐
40
reference pytorch code for intent classification
Pg_onnx
⭐
37
pg_onnx: ONNX Runtime integrated with PostgreSQL. Perform ML inference with data in your database.
Object Detection Inference
⭐
37
C++ object detection inference from video or image input source
Celerymath
⭐
36
Another LaTex equation OCR tool based on ConvNeXt and Transformer
Rawmangareader
⭐
36
An OCR App for Veritcal Japanese
Pytorch Onnx Tensorrt
⭐
35
A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3
Onnxruntime.jl
⭐
35
Julia bindings for onnxruntime
Buildseg
⭐
35
buildseg is a building extraction plugin of QGIS based on ONNX『buildseg是一个基于ONNX的用于建筑提取的QGIS插件』
Onnx Ultra Fast Lane Detection Inference
⭐
35
Example scripts for the detection of lanes using the ultra fast lane detection model in ONNX.
Efficientnet Lite Keras
⭐
32
Keras reimplementation of EfficientNet Lite.
Deep Object Reid
⭐
31
OpenVINO Training Extensions Object Re-identification
Ddddocr For Java
⭐
29
基于sml2h3开源的ddddocr构建的java开源项目
Ml Edge Getting Started
⭐
29
Infery Examples
⭐
28
A collection of demo-apps and inference scripts for various deep learning frameworks using infery (Python).
Fastgpt
⭐
28
⚡ boost inference speed of GPT models in transformers by onnxruntime
Onnx_clip
⭐
27
An ONNX-based implementation of the CLIP model that doesn't depend on torch or torchvision.
Ort Builder
⭐
27
ONNX Runtime static library builder
Amuse
⭐
27
.NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within the .NET eco-system
Yolov5 Onnxruntime
⭐
27
YOLOv5 ONNX Runtime C++ inference code.
Distributed Inference
⭐
26
A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.
Utttai
⭐
25
AlphaZero-like AI solution for playing Ultimate Tic-Tac-Toe in the browser
Tonnxruntime
⭐
25
TOnnxRuntime is a Microsoft ONNXRuntime AI and Machine Learning Library for Freepascal / Delphi
Ocrliteandroidonnx
⭐
24
chineseocr lite android onnx ,超轻量级中文ocr android demo,支持竖排文字识别, 支持onnx推理(psenet+anglenet+crnn)
Yolov8 Onnxruntime Web
⭐
24
YOLOv8 right in your browser with onnxruntime-web
Allegro Music Transformer
⭐
24
Full-attention multi-instrumental music transformer featuring asymmetrical encoding with octo-velocity, and chords counters tokens, optimized for speed and performance
Onnx Crestereo Depth Estimation
⭐
23
Python scripts performing stereo depth estimation using the CREStereo model in ONNX.
Yolo Nas Onnxruntime
⭐
22
This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/float16/int8 inference.
Onnx Runtime With Tensorrt And Openvino
⭐
21
Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
Model Inference Deployment
⭐
21
A curated list of awesome inference deployment framework of artificial intelligence models.
Onnx Hitnet Stereo Depth Estimation
⭐
21
Python scripts form performing stereo depth estimation using the HITNET model in ONNX.
Dl Benchmark
⭐
21
Deep Learning Inference benchmark. Supports Intel® Distribution of OpenVINO™ Toolkit, Caffe, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch and Apache TVM
1-100 of 191 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.