Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Inference Engine Open Source Projects

Open source projects categorized as Inference Engine
Categories > Inference Engine
Tengine ⭐ 4,452
Tengine is a lite, high performance, modular inference engine for embedded device
most recent commit 6 months ago
Fedml ⭐ 3,946
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://nexus.fedml.ai) is the dedicated cloud service for generative AI
dependent packages 1total releases 342most recent commit 3 months agopypi fedml} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103most recent commit 3 months agopypi ctranslate2} Downloads
Grule Rule Engine ⭐ 1,939
Rule engine implementation in Golang
dependent packages 33total releases 61most recent commit 3 months ago
Kuiperinfer ⭐ 1,706
带你从零实现一个高性能的深度学习推理库，支持Unet、Yolov5、Resnet等模型的推理。Imp a high-performance deep learning inference library step by step
most recent commit 3 months ago
Nitro ⭐ 1,115
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
most recent commit 3 months ago
Feathercnn ⭐ 1,052
FeatherCNN is a high performance inference engine for convolutional neural networks.
most recent commit 5 years ago
Paddle.js ⭐ 873
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.
total releases 9most recent commit 6 months ago
Stable Fast ⭐ 815
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
most recent commit 3 months ago
Onediff ⭐ 787
OneDiff: An out-of-the-box acceleration library for diffusion models.
most recent commit 3 months ago
Adlik ⭐ 688
Adlik: Toolkit for Accelerating Deep Learning Inference
most recent commit 10 months ago
Msnhnet ⭐ 666
🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.
most recent commit a year ago
Astroid ⭐ 509
A common base representation of python source code for pylint and other projects
dependent packages 390total releases 150most recent commit 17 days agopypi astroid} Downloads
Anakin ⭐ 492
High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
most recent commit 4 years ago
Forward ⭐ 491
A library for high performance deep learning inference on NVIDIA GPUs.
most recent commit 2 years ago
Holoclean ⭐ 485
A Machine Learning System for Data Enrichment.
most recent commit 10 months ago
Wongi Engine ⭐ 468
A rule engine written in Ruby.
total releases 58most recent commit 8 months ago
Libonnx ⭐ 451
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
most recent commit a year ago
Savant ⭐ 408
Python Computer Vision & Video Analytics Framework With Batteries Included
most recent commit 3 months ago
Noscope ⭐ 397
Accelerating network inference over video
most recent commit 4 years ago
Emlearn ⭐ 327
Machine Learning inference engine for Microcontrollers and Embedded devices
total releases 30most recent commit 3 months ago
Pyknow ⭐ 271
PyKnow: Expert Systems for Python
total releases 12most recent commit 4 years ago
Opennars ⭐ 252
OpenNARS for Research 3.0+
most recent commit 3 years ago
The 10 Most Depended On Inference Engine Open Source Projects
Astroid ⭐ 509
A common base representation of python source code for pylint and other projects
dependent packages 390total releases 150latest release October 16, 2023most recent commit 17 days agopypi astroid} Downloads
Grule Rule Engine ⭐ 1,939
Rule engine implementation in Golang
dependent packages 33total releases 61latest release August 29, 2023most recent commit 3 months ago
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Pomagma ⭐ 15
An inference engine for extensional untyped λ-calculus
dependent packages 5total releases 13latest release July 23, 2015most recent commit a year agonpm pomagma} Downloads
Inference Engine Node ⭐ 33
Bringing the hardware accelerated deep learning inference to Node.js and Electron.js apps.
dependent packages 2total releases 7latest release December 30, 2020most recent commit a year agonpm inference-engine-node} Downloads
Planer ⭐ 45
Powerful Light Artificial NEuRon inference framework for CNN
dependent packages 2total releases 27latest release March 06, 2022most recent commit 2 years agopypi planer} Downloads
Opencv Python Inference Engine ⭐ 33
Wrapper package for OpenCV with Inference Engine python bindings.
dependent packages 1total releases 25latest release January 04, 2022most recent commit a year agopypi opencv-python-inference-engine} Downloads
Constant_resolver ⭐ 25
Resolve a partially qualified Ruby constant reference to the fully qualified name and the path of the file defining it.
dependent packages 1total releases 1latest release December 18, 2019most recent commit a year agorubygems constant_resolver} Downloads
Titus2 ⭐ 22
Titus 2 : Portable Format for Analytics (PFA) implementation for Python 3.4+
dependent packages 1total releases 4latest release September 23, 2020most recent commit a year agopypi titus2} Downloads
The 10 Latest Releases In Inference Engine Open Source Projects
Aphrodite Engine ⭐ 199
PygmalionAI's large-scale inference engine
total releases 13latest release December 19, 2023most recent commit 3 months ago
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Emlearn ⭐ 327
Machine Learning inference engine for Microcontrollers and Embedded devices
total releases 30latest release November 27, 2023most recent commit 3 months ago
Csi Nn2 ⭐ 61
An optimized neural network operator library for chips base on Xuantie CPU.
total releases 2latest release October 20, 2023most recent commit 3 months ago
Astroid ⭐ 509
A common base representation of python source code for pylint and other projects
dependent packages 390total releases 150latest release October 16, 2023most recent commit 17 days agopypi astroid} Downloads
Server ⭐ 58
A standalone inference server for trained Rubix ML estimators.
total releases 18latest release September 19, 2023most recent commit 7 months ago
Wongi Engine Elixir ⭐ 13
A rule engine written in Elixir.
total releases 14latest release September 04, 2023most recent commit 4 months ago
Grule Rule Engine ⭐ 1,939
Rule engine implementation in Golang
dependent packages 33total releases 61latest release August 29, 2023most recent commit 3 months ago
Wongi Engine ⭐ 468
A rule engine written in Ruby.
total releases 58latest release June 15, 2023most recent commit 8 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.