Awesome Open Source

Programming Languages

Search results for quantization llama

8 search results found

Chinese Llama Alpaca ⭐ 15,877

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Llama Factory ⭐ 10,715

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Squeezellm ⭐ 486

SqueezeLLM: Dense-and-Sparse Quantization

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Llama.onnx ⭐ 196

LLaMa/RWKV onnx models, quantization and testcase

Takeoff Community ⭐ 109

TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models accessible to everyone.

Intllama ⭐ 17

IntLLaMA: A fast and light quantization solution for LLaMA

Something in the middle of Karpathy's mingpt model and video lectures, BabyGPT is an easy to use model on a much smaller scale (16 and 256 out channels , 5 heads, fine tuned). To be made useful on low powered devices.

Related Searches

Python Quantization (352)

Llm Llama (289)

Python Llama (83)

1-8 of 8 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.