Awesome Open Source

Programming Languages

Search results for c plus plus onnx

114 search results found

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

Tengine ⭐ 4,452

Tengine is a lite, high performance, modular inference engine for embedded device

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts

Onnx Simplifier ⭐ 3,353

Simplify your onnx model

Lite.ai.toolkit ⭐ 3,319

🛠 A lite C++ toolkit of awesome AI models with ONNXRuntime, NCNN, MNN and TNN. YOLOv5, YOLOX, YOLOP, YOLOv6, YOLOR, MODNet, YOLOX, YOLOv7, YOLOv8. MNN, NCNN, TNN, ONNXRuntime.

Onnx Tensorrt ⭐ 2,630

ONNX-TensorRT: TensorRT backend for ONNX

Fastdeploy ⭐ 2,547

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Onnxstream ⭐ 1,598

Stable Diffusion XL 1.0 Base on a Raspberry Pi Zero 2 (or in 298MB of RAM)

Flexflow ⭐ 1,358

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

Ngraph ⭐ 1,310

nGraph - open source C++ library, compiler and runtime for Deep Learning

Ppl.nn ⭐ 1,161

A primitive library for neural network

Yolov8 Tensorrt ⭐ 895

YOLOv8 using TensorRT accelerate !

Nnfusion ⭐ 877

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

Bolt is a deep learning library with high performance and heterogeneous flexibility.

Machine learning framework for both deep learning and traditional algorithms

Tiny Tensorrt ⭐ 739

Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型

Libfacedetection.train ⭐ 720

The training program for libfacedetection for face detection and 5-landmark detection.

Stable Diffusion Ncnn ⭐ 701

Stable Diffusion in NCNN with c++, supported txt2img and img2img

Tensorrt_inference ⭐ 636

Onnx Mlir ⭐ 623

Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure

dabnn is an accelerated binary neural networks inference framework for mobile platform

Axodox Machinelearning ⭐ 549

This repository contains a C++ ONNX implementation of StableDiffusion.

Optimizer ⭐ 537

Actively maintained ONNX Optimizer

The Tensor Algebra SuperOptimizer for Deep Learning

Forward ⭐ 491

A library for high performance deep learning inference on NVIDIA GPUs.

Open Neural Network Compiler

Tensorrtintegrate ⭐ 430

TensorRT ONNX Plugin、Inference、Compile

Tensorrt ⭐ 370

TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等可训练自己数据

Dcnv2_latest ⭐ 349

DCNv2 supports decent pytorch such as torch 1.5+ (now 1.8+)

Ai.deploy.box ⭐ 287

A toolbox for deep learning model deployment using C++ YoloX | YoloV7 | YoloV8 | Gan | OCR | MobileVit | Scrfd | MobileSAM

Mnn Applications ⭐ 285

MNN applications by MNN, JNI exec, RK3399. Support tflite\tensorflow\caffe\onnx models.

Php Opencv ⭐ 278

php wrapper for opencv

Menoh: fast DNN inference library with multiple programming language support

Backend ⭐ 225

Common source, scripts and utilities for creating Triton backends.

Unpaint ⭐ 224

A simple Windows / Xbox app for generating AI images with Stable Diffusion.

Deepstream_pose_estimation ⭐ 210

This is a sample DeepStream application to demonstrate a human pose estimation pipeline.

Vs Mlrt ⭐ 189

Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE and more!)

Onnx_runtime_cpp ⭐ 176

small c++ library to quickly deploy models using onnxruntime

GLake: optimizing GPU memory management and IO transmission.

Centernet Tensorrt ⭐ 143

This is a C++ implementation of CenterNet using TensorRT and CUDA

Onnx Runtime Inference ⭐ 141

ONNX Runtime Inference C++ Example

Onnxruntime_backend ⭐ 103

The Triton backend for the ONNX Runtime.

Play_with_tensorrt ⭐ 101

Sample projects for TensorRT in C++

Rvm Inference ⭐ 100

🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.

Amdovx Modules ⭐ 96

AMD OpenVX modules: such as, neural network inference, 360 video stitching, etc.

ONNX DART LIBRARY

Lffd Mnn ⭐ 93

MNN Implementation of the paper of LFFD: A Light and Fast Face Detector for Edge Devices

Pytorch Android ⭐ 91

[EXPERIMENTAL] Demo of using PyTorch 1.0 inside an Android app. Test with your own deep neural network such as ResNet18/SqueezeNet/MobileNet v2 and a phone camera.

Centernet_tensorrt_cpp ⭐ 89

plan to finishe cpp pre process verison of CenterNet with TensorRT speedup

Lffd With Ncnn ⭐ 87

A C++ API of the LFFD with ncnn

Pytorch Inference ⭐ 85

PyTorch 1.0 inference in C++ on Windows10 platforms

Lightglue Onnxrunner ⭐ 85

LightGlue-OnnxRunner is a repository hosts the C++ inference code of LightGlue in ONNX format，supporting end-to-end/decouple model inference of SuperPoint/DISK + LightGlue

Onnxruntime Projects ⭐ 79

Code for some onnxruntime projects

Alphartc ⭐ 76

Evaluation framework for RL-based bitrate control for WebRTC

Tengine Convert Tools ⭐ 72

Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.

Yolov5_cpp_openvino ⭐ 71

用c++实现了yolov5使用openvino的部署

Onnxruntime Server ⭐ 69

ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.

DNN Inference with CPU, C++, ONNX support: Instant

Deep Stream Onnx ⭐ 55

How to deploy ONNX models using DeepStream on Jetson Nano

Yolov3 Tensorrt ⭐ 55

Run YoloV3 with the newest TensorRT6.0 at 37 fps on NVIIDIA 1060.

Poplar Advanced Runtime for the IPU

Yolo Nas Onnx ⭐ 51

Inference YOLO-NAS ONNX model

Psgan Ncnn ⭐ 50

PSGAN running with ncnn⚡妆容迁移/仿妆⚡Imitation Makeup/Makeup Transfer⚡

Onnx Yolov5 ⭐ 49

deploy yolov5 in c++

Onnxparser Trt Plugin Sample ⭐ 48

A sample for onnxparser working with trt user defined plugins for TRT7.0

Tensorrt Centernet 3d ⭐ 47

tensorrt5, centernet, 3d detection, kitti, centerface, deform conv, int8,

Aiassistonnx ⭐ 45

这是AI游戏助手的最新版代码库，其他的代码库已停止更新。AI游戏助手截取游戏屏幕进行对象识别，模拟自

Ocrliteandroidncnn ⭐ 43

Chineseocr Lite Android Onnx To Ncnn Demo，超轻量级中文OCR Android Demo，支持ncnn推理

Pico Cnn ⭐ 40

Lightweight C implementation of CNNs for Embedded Systems

pg_onnx: ONNX Runtime integrated with PostgreSQL. Perform ML inference with data in your database.

Draggan Ncnn ⭐ 37

DragGan in NCNN with c++

Tensorrt_models ⭐ 36

Project aimed at making cpp inference on TensorRT from python

Caffe2 Tutorial ⭐ 35

Caffe2 C++/Python tutorial with full demo

Cheetahinfer ⭐ 33

A C++ inference SDK based on TensorRT

Deepstream_triton_model_deploy ⭐ 32

How to deploy open source models using DeepStream and Triton Inference Server

Tensorrt_seg_lw_refinenet ⭐ 32

一个简单的TensorRT实现语义分割的C++程序

Dasiamrpn Caffe2 ⭐ 29

Distractor-aware Siamese Networks for Visual Object Tracking Inference in C++ powered by Caffe2

Ort Builder ⭐ 27

ONNX Runtime static library builder

Yolov5 Onnxruntime ⭐ 27

YOLOv5 ONNX Runtime C++ inference code.

Openvino_pytorch_layers ⭐ 26

How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO

Ocrlitencnn ⭐ 26

chineseocr lite onnx to ncnn，超轻量级中文ocr demo，支持ncnn推理 ( dbnet+crnn+anglenet)

Pytorch implements SA-Text: Simple but Accurate Detector for Text of Arbitrary Shapes

Onnc Tutorial ⭐ 25

Person Detection ⭐ 23

TensorRT person tracking RFBNet300

Tensorrt Yolov4 ⭐ 23

tensorrt5, yolov4, yolov3,yolov3-tniy,yolov3-tniy-prn

Project has moved to: https://github.com/onnx/onnx-mlir

Ros_msft_onnx ⭐ 20

ONNX Runtime for the Robot Operating System (ROS), works on ROS1 and ROS2

Yolov5_caffe ⭐ 17

yolov5 onnx caffe

Mediapipe_plus ⭐ 16

The purpose of this project is to apply mediapipe to more AI chips.

Onnxruntime_flutter ⭐ 16

Flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.

Yet another ssd, with its runtime stack for libtorch, onnx and specialized accelerators.

Keras To Realtime Audio ⭐ 13

Onnxruntime Node Gpu ⭐ 13

Drop-in replacement for onnxruntime-node with GPU support using CUDA or DirectML

Image Animation Turbo Boost ⭐ 13

Aim to accelerate the image-animation-model inference through the inference frameworks such as onnx、tensorrt and openvino.

Onnx2text ⭐ 13

Converts an ONNX ML model protobuf from/to text, or tensor from/to text/CSV/raw data. (Windows command line tool)

Ailia Models Cpp ⭐ 12

C++ version of ailia models repository

Yolov3 Tiny Onnx Tensorrt ⭐ 12

YOLOV3-Tiny TensorRT6.0 13个类别

Onnx Xla ⭐ 11

XLA integration of Open Neural Network Exchange (ONNX)

Ncnn Poseestimation ⭐ 11

Realtime Pose Estimation NCNN ONNX

Menoh_ros ⭐ 11

Related Searches

C Plus Plus Cmake (8,712)

C Plus Plus Qt (8,557)

C Plus Plus Video Game (8,255)

C Plus Plus Algorithms (6,194)

Python C Plus Plus (6,129)

C Plus Plus Opengl (4,396)

C Plus Plus 3d Graphics (3,196)

C Plus Plus Testing (2,735)

Java C Plus Plus (2,629)

C Plus Plus Command Line (2,304)

1-100 of 114 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.