Tinychatengine

TinyChatEngine: On-Device LLM Inference Library
Alternatives To Tinychatengine
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Mnn8,07734 months ago2October 23, 2020217C++
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Paddle Lite6,823
a month ago1,220apache-2.0C++
PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎)
Utensor1,607
4 months ago55apache-2.0C++
TinyML AI inference library
Bolt823
a year ago38mitC++
Bolt is a deep learning library with high performance and heterogeneous flexibility.
Megcc441
5 months ago9apache-2.0C++
MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器
Tinychatengine407
3 months ago18mitC++
TinyChatEngine: On-Device LLM Inference Library
Ml Examples381
9 months ago31apache-2.0C++
Arm Machine Learning tutorials and examples
In Prestissimo267
6 years ago2otherC++
A very fast neural network computing framework optimized for mobile platforms.QQ group: 676883532 【验证信息输:绝影】
Play_with_tflite225
2 years agoapache-2.0C++
Sample projects for TensorFlow Lite in C++ with delegates such as GPU, EdgeTPU, XNNPACK, NNAPI
Pytorch Aarch64191
a year ago12mitHTML
PyTorch wheels (whl) & conda for aarch64 / ARMv8 / ARM64
Alternatives To Tinychatengine
Select To Compare


Alternative Project Comparisons
Popular Deep Learning Projects
Popular Arm Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
C Plus Plus
C
Deep Learning
Arm
Quantization
X86 64
Edge Computing