Tengine

Tengine is a lite, high performance, modular inference engine for embedded device
Alternatives To Tengine
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Transformers101,817649119 hours ago91June 21, 2022719apache-2.0Python
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Pytorch67,25014610 hours ago23August 10, 202212,004otherPython
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Yolov538,857
a day ago35May 21, 2022346agpl-3.0Python
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
Made With Ml33,193
a month ago5May 15, 201911mitJupyter Notebook
Learn how to responsibly develop, deploy and maintain production machine learning applications.
Ray25,7678019910 hours ago76June 09, 20222,839apache-2.0Python
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.
Deepspeed25,0731215 hours ago53May 25, 2022864apache-2.0Python
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Fastai23,942184117a day ago143July 04, 2022156apache-2.0Jupyter Notebook
The fastai deep learning library
Lightning23,372738920 hours ago221June 01, 2022678apache-2.0Python
Deep learning framework to train, deploy, and ship AI products Lightning fast.
Netron22,89646313 hours ago489July 04, 202226mitJavaScript
Visualizer for neural network, deep learning, and machine learning models
Annotated_deep_learning_paper_implementations22,464116 days ago76June 27, 202217mitJupyter Notebook
🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Alternatives To Tengine
Select To Compare


Alternative Project Comparisons
Readme

Tengine Overview

GitHub license Build Status Test Status

Tengine, developed by OPEN AI LAB, is an AI application development platform for AIoT scenarios launched by OPEN AI LAB, which is dedicated to solving the fragmentation problem of aiot industrial chain and accelerating the landing of AI industrialization. Tengine is specially designed for AIoT scenarios, and it has several features, such as cross platform, heterogeneous scheduling, chip bottom acceleration, ultra light weight and independent, and complete development and deployment tool chain. Tengine is compatible with a variety of operating systems and deep learning algorithm framework, which simplifies and accelerates the rapid migration of scene oriented AI algorithm on embedded edge devices, as well as the actual application deployment;

Tengine is composed of five modules: core/operator/serializer/executor/driver.

  • core provides the basic components and functionalities of the system.
  • operator defines the schema of operators, such as convolution, relu, pooling, etc. al. Here is the current support operator list.
  • serializer is to load the saved model. The serializer framework is extensible to support different format, including the customized one. Caffe/ONNX/Tensorflow/MXNet and Tengine models can be loaded directly by Tengine.
  • executor implements the code to run graph and operators. Current version provides a highly optimized implementation for multi A72 cores.
  • driver is the adapter of real H/W and provides service to device executor by HAL API. It is possible for single driver to create multiple devices.

Build and Install

please refer to Wiki

Tengine examples and model zoo

please visit examples for demos on classification/detection and download models from Tengine model zoo (psw: hhgc)

tengine applications is a project for sharing android/linux applications powered by Tengine

Communication && Tech Support

Benchmark

Test on RK3399-1*A72

Model fp32 int8-hybrid int8-e2e
Squeezenet v1.1 55.3ms 48.6ms 44.6ms
Mobilenet v1 108.7ms 74.6ms 64.2ms

More Benchmark data to be added.

Roadmap

2020.5 updated

Feature
  • [ ] More examples
  • [ ] Web-based convert tool
  • [ ] CV API
  • [ ] Support more ops of ONNX(PyTorch)
Optimization
  • [ ] arm v8.2 fp16 perf ops
Popular Machine Learning Projects
Popular Pytorch Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
C Plus Plus
Machine Learning
Pytorch
Tensorflow
Artificial Intelligence
Ai
Cnn
Arm
Acl
Mips
Risc V
Onnx
X86 64