Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for inference engine
inference-engine
x
121 search results found
Tengine
⭐
4,452
Tengine is a lite, high performance, modular inference engine for embedded device
Fedml
⭐
3,946
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://nexus.fedml.ai) is the dedicated cloud service for generative AI
Ctranslate2
⭐
2,437
Fast inference engine for Transformer models
Grule Rule Engine
⭐
1,939
Rule engine implementation in Golang
Kuiperinfer
⭐
1,706
带你从零实现一个高性能的深度学习推理库,支持Unet、Yolov5、Resnet等模型的推理。Imp a high-performance deep learning inference library step by step
Nitro
⭐
1,115
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Feathercnn
⭐
1,052
FeatherCNN is a high performance inference engine for convolutional neural networks.
Paddle.js
⭐
873
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.
Stable Fast
⭐
815
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
Onediff
⭐
787
OneDiff: An out-of-the-box acceleration library for diffusion models.
Adlik
⭐
688
Adlik: Toolkit for Accelerating Deep Learning Inference
Msnhnet
⭐
666
🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.
Astroid
⭐
509
A common base representation of python source code for pylint and other projects
Anakin
⭐
492
High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
Forward
⭐
491
A library for high performance deep learning inference on NVIDIA GPUs.
Holoclean
⭐
485
A Machine Learning System for Data Enrichment.
Wongi Engine
⭐
468
A rule engine written in Ruby.
Libonnx
⭐
451
A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.
Savant
⭐
408
Python Computer Vision & Video Analytics Framework With Batteries Included
Noscope
⭐
397
Accelerating network inference over video
Emlearn
⭐
327
Machine Learning inference engine for Microcontrollers and Embedded devices
Pyknow
⭐
271
PyKnow: Expert Systems for Python
Opennars
⭐
252
OpenNARS for Research 3.0+
Compute Engine
⭐
232
Highly optimized inference engine for Binarized Neural Networks
Aphrodite Engine
⭐
199
PygmalionAI's large-scale inference engine
Bmw Tensorflow Inference Api Cpu
⭐
182
This is a repository for an object detection inference API using the Tensorflow framework.
Search Legend
⭐
181
docs for search system and ai infra
Mivisionx
⭐
179
MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimized open-source implementation of the Khronos OpenVX™ and OpenVX™ Extensions.
Aidget
⭐
146
Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型
Cnn Inference Engine Quick View
⭐
142
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
Tinytensor
⭐
108
TinyTensor is a tool for running already trained NN (Neural Network) models to be able to use them for inference of various tasks such as image classification, semantic segmentation, etc.
Daisykit
⭐
91
DaisyKit is an easy AI toolkit with face mask detection, pose detection, background matting, barcode detection, face recognition and more. - with NCNN, OpenCV, Python wrappers
Openvino_contrib
⭐
91
Repository for OpenVINO's extra modules
Experta
⭐
88
Expert Systems for Python
Deep Vision Processing
⭐
74
Deep computer-vision algorithms for the Processing framework.
Holoclean Legacy Deprecated
⭐
74
A Machine Learning System for Data Enrichment.
Bmw Intelopenvino Detection Inference Api
⭐
70
This is a repository for a No-Code object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.
Nn Inference Template
⭐
63
Neural network inference template for real-time cricital audio environments - presented at ADC23
Object Tracking Line Crossing Area Intrusion
⭐
63
Deep learning based object tracking with line crossing and area intrusion detection
Csi Nn2
⭐
61
An optimized neural network operator library for chips base on Xuantie CPU.
Server
⭐
58
A standalone inference server for trained Rubix ML estimators.
Pytorch Inference
⭐
50
OpenCL Inference Engine for pytorch
Torsten
⭐
50
library of C++ functions that support applications of Stan in Pharmacometrics
Ure
⭐
50
Unified Rule Engine. Graph rewriting system for the AtomSpace. Used as reasoning engine for OpenCog.
Jools
⭐
49
JavaScript Rule Engine
Bird Watcher Fin
⭐
47
Parliament
⭐
47
Standards-compliant triple store for RDF, OWL, and SPARQL
Fast Llama
⭐
46
Runs LLaMA with Extremely HIGH speed
Planer
⭐
45
Powerful Light Artificial NEuRon inference framework for CNN
Bipartitesbm
⭐
44
Heuristic and inference engine for estimating the number of communities in a bipartite network
Ros_openvino
⭐
39
A ROS package to wrap openvino inference engine and get it working with Myriad and GPU
Mpsx
⭐
39
GPU tensor framework with support for running ONNX models
Grool
⭐
39
Golang Rule Engine
Facenet_mtcnn_tensorflow_inference_engine
⭐
36
This is a modified and simplified inference engine of davidsandberg's facenet
Yaps
⭐
35
A surface language for programming Stan models using python syntax
Inference Engine Node
⭐
33
Bringing the hardware accelerated deep learning inference to Node.js and Electron.js apps.
Opencv Python Inference Engine
⭐
33
Wrapper package for OpenCV with Inference Engine python bindings.
Idverification
⭐
33
"Very simple but works well" Computer Vision based ID verification solution provided by LibraX.
Cheetahinfer
⭐
33
A C++ inference SDK based on TensorRT
Chainer Trt
⭐
31
Chainer x TensorRT
Zoidberg
⭐
31
A natural language word problem solver written in Python
Lisp Inference
⭐
31
An Inference Engine based on Propositional Calculus written in Common Lisp
Gaze Estimation With Laser Sparking
⭐
26
Deep learning based gaze estimation demo with a fun feature :-)
Refactorgraph
⭐
25
分层解耦的深度学习推理引擎
Constant_resolver
⭐
25
Resolve a partially qualified Ruby constant reference to the fully qualified name and the path of the file defining it.
Interactive Image Inpainting
⭐
24
Deep Learning Based Interactive Image Inpainting Demo
Intel Edge Ai For Iot
⭐
23
Intel® Edge AI Foundation and IOT reading material
Dbface On Openvino
⭐
23
Describes how to run DBFace, a real-time, single-shot face detection model on Intel OpenVINO
Friendli Client
⭐
23
Friendli: the fastest serving engine for generative AI such as LLMs
Conceptnet5 Client
⭐
23
Python programming interface and graph walk inference engine for ConceptNet5 Web API
Titus2
⭐
22
Titus 2 : Portable Format for Analytics (PFA) implementation for Python 3.4+
R2inference
⭐
21
RidgeRun Inference Framework
Inteledgeainotes
⭐
21
Notes Intel Edge AI
Ncs
⭐
20
Movidius Neural Compute Stick V2.0 API Go bindings
Exa
⭐
17
Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.
Zig_gpt2
⭐
17
GPT-2 inference engine written in Zig
Simpleinfer
⭐
17
A simple neural network inference framework
Handwritten Japanese Ocr
⭐
17
Handwritten Japanese OCR demo using touch panel to draw the input text using Intel OpenVINO toolkit
Yolooclinference
⭐
16
Rdfs
⭐
16
[OBSOLETE] A forward-chaining inference engine that implements the RDFS entailment rules.
Pomagma
⭐
15
An inference engine for extensional untyped λ-calculus
Psilo
⭐
15
a parallel, safe, iterative list operation language for systems programming
19 Questions
⭐
15
A machine learning / bayesian inference engine assigning attributes to objects
Myclips
⭐
15
A Rete-based, CLIPS-clone, inference engine in Python.
Nadia
⭐
13
This is an open source project for building Rule/Policy Inference Engine written in Java
Wongi Engine Elixir
⭐
13
A rule engine written in Elixir.
Armednn
⭐
13
cross-platform modular neural network inference library, small and efficient
Android Medical Assistant
⭐
13
An android chatbot that analyzes your medical symptoms
Latte
⭐
12
Latte is a convolutional neural network (CNN) inference engine written in C++ and uses AVX to vectorize operations. The engine runs on Windows 10, Linux and macOS Sierra.
Phenome_model
⭐
12
The Unsupervised Phenome Model (UPhenome) for learning phenotypes on heterogeneous EHR data
People Counter App
⭐
11
People counter app is used for monitoring people at specific area.
Reddit Flair Predictor
⭐
10
Created a Reddit flair detector
Inference Engine
⭐
10
📦 Node.js Logical reasoning machine (WIP)
Tensorrt 5_inference_engine_python
⭐
10
TensorRT-5 based inference engine in Python
Yolooclinference
⭐
9
An extremely light weight tiny-YOLO inference engine targeted towards OpenCL hardware.
3d_neurosim_v1.0
⭐
9
Benchmark framework of 3D integrated CIM accelerators for popular DNN inference, support both monolithic and heterogeneous 3D integration
Easyocr Cpp
⭐
9
Custom C++ implementation of deep learning based OCR
Bayesianfridge
⭐
8
Sequential Monte Carlo sampler for PyMC2 models.
Attack Graphs
⭐
8
Attack graph construction and analysis
Pygol
⭐
7
A novel Inductive Logic Programming(ILP) system based on Meta Inverse Entailment in Python.
1-100 of 121 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.