Awesome Open Source

Programming Languages

Search results for language model quantization

language-model x

7 search results found

Llama Factory ⭐ 10,715

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

Mixtral Offloading ⭐ 1,943

Run Mixtral-8x7B models in Colab or consumer desktops

Rwkv.cpp ⭐ 956

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Gptq_for_langchain ⭐ 28

A guide about how to use GPTQ models with langchain

Awd Lstm Tensorflow ⭐ 9

AWD-LSTM from "Regularizing and Optimizing LSTM Language Models" with training-award quantization support for tensorflow.

Something in the middle of Karpathy's mingpt model and video lectures, BabyGPT is an easy to use model on a much smaller scale (16 and 256 out channels , 5 heads, fine tuned). To be made useful on low powered devices.

Related Searches

Python Language Model (867)

Python Quantization (352)

1-7 of 7 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.