Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 C Plus Plus Deep Learning Inference Open Source Projects

Open source projects categorized as C Plus Plus Deep Learning Inference
Categories > Programming Languages > C Plus Plus
Categories > Machine Learning > Deep Learning
Categories > Machine Learning > Inference
Mediapipe ⭐ 24,511
Cross-platform, customizable ML solutions for live and streaming media.
dependent packages 190total releases 38most recent commit 3 months agopypi mediapipe} Downloads
Jetson Inference ⭐ 7,038
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
most recent commit 4 months ago
Serving ⭐ 6,045
A flexible, high-performance serving system for machine learning models
most recent commit 3 months ago
Openvino ⭐ 5,316
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
total releases 3most recent commit 3 months ago
Tnn ⭐ 4,210
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
most recent commit 3 months ago
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103most recent commit 3 months agopypi ctranslate2} Downloads
Kuiperinfer ⭐ 1,706
带你从零实现一个高性能的深度学习推理库，支持Unet、Yolov5、Resnet等模型的推理。Imp a high-performance deep learning inference library step by step
most recent commit 3 months ago
Neuropod ⭐ 916
A uniform interface to run deep learning models from multiple frameworks
most recent commit a year ago
Deepbench ⭐ 882
Benchmarking Deep Learning operations on different hardware
most recent commit 4 years ago
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21most recent commit 7 months agopypi paddle-serving-client} Downloads
Bolt ⭐ 823
Bolt is a deep learning library with high performance and heterogeneous flexibility.
most recent commit 10 months ago
Adlik ⭐ 688
Adlik: Toolkit for Accelerating Deep Learning Inference
most recent commit 10 months ago
Model_server ⭐ 618
A scalable inference server for models optimized with OpenVINO™
dependent packages 4total releases 6most recent commit 3 months agopypi ovmsclient} Downloads
Forward ⭐ 491
A library for high performance deep learning inference on NVIDIA GPUs.
most recent commit 2 years ago
Gotch ⭐ 444
Go binding for Pytorch C++ API (libtorch)
dependent packages 6total releases 72most recent commit 5 months ago
Inferllm ⭐ 440
a lightweight LLM model inference framework
most recent commit 7 months ago
Gpu Rest Engine ⭐ 391
A REST API for Caffe using Docker and Go
most recent commit 6 years ago
Tensorflow Cmake ⭐ 371
TensorFlow examples in C, C++, Go and Python without bazel but with cmake and FindTensorFlow.cmake
most recent commit 5 years ago
Cubert ⭐ 349
Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL
most recent commit 3 years ago
Dancinggaga ⭐ 304
AI 尬舞机
most recent commit 5 years ago
Menoh ⭐ 276
Menoh: fast DNN inference library with multiple programming language support
total releases 5most recent commit 3 years ago
Deepstream Services Library ⭐ 234
A shared library of on-demand DeepStream Pipeline Services for Python and C/C++
most recent commit 3 months ago
Tensorrt Laboratory ⭐ 193
Explore the Capabilities of the TensorRT Platform
most recent commit 4 years ago
The 5 Most Depended On C Plus Plus Deep Learning Inference Open Source Projects
Mediapipe ⭐ 24,511
Cross-platform, customizable ML solutions for live and streaming media.
dependent packages 190total releases 38latest release November 09, 2023most recent commit 3 months agopypi mediapipe} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Gotch ⭐ 444
Go binding for Pytorch C++ API (libtorch)
dependent packages 6total releases 72latest release October 30, 2023most recent commit 5 months ago
Model_server ⭐ 618
A scalable inference server for models optimized with OpenVINO™
dependent packages 4total releases 6latest release September 18, 2023most recent commit 3 months agopypi ovmsclient} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
The 8 Latest Releases In C Plus Plus Deep Learning Inference Open Source Projects
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Mediapipe ⭐ 24,511
Cross-platform, customizable ML solutions for live and streaming media.
dependent packages 190total releases 38latest release November 09, 2023most recent commit 3 months agopypi mediapipe} Downloads
Gotch ⭐ 444
Go binding for Pytorch C++ API (libtorch)
dependent packages 6total releases 72latest release October 30, 2023most recent commit 5 months ago
Model_server ⭐ 618
A scalable inference server for models optimized with OpenVINO™
dependent packages 4total releases 6latest release September 18, 2023most recent commit 3 months agopypi ovmsclient} Downloads
Serving ⭐ 834
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
dependent packages 4total releases 21latest release May 24, 2022most recent commit 7 months agopypi paddle-serving-client} Downloads
Openvino ⭐ 5,316
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
total releases 3latest release November 19, 2021most recent commit 3 months ago
Go Tensorrt ⭐ 9
Go binding to TensorRT C API to do inference with pre-trained model in Go
total releases 2latest release November 19, 2018most recent commit 4 years ago
Menoh ⭐ 276
Menoh: fast DNN inference library with multiple programming language support
total releases 5latest release October 25, 2018most recent commit 3 years ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.