Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+t / s，支持glm, llama, moss基座，手机端流畅运行
Stars
2,765
License
apache-2.0
Open Issues
203
Most Recent Commit
6 months ago
Programming Language
C++
Categories
Repo
Suggest An Alternative To fastllm

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
C Plus Plus
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.