Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Fastllama

fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backend.
Stars
363
License
mit
Open Issues
8
Most Recent Commit
a year ago
Programming Language
C
Categories
Site
Repo
Suggest An Alternative To fastLLaMa
Related Searches
Python C
Python Lama

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
C Plus Plus
C
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.