Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Quantization Open Source Projects

Open source projects categorized as Python Quantization
Categories > Machine Learning > Quantization
Chinese Llama Alpaca ⭐ 15,877
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
most recent commit 4 months ago
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19most recent commit 3 months ago
Pinto_model_zoo ⭐ 3,121
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
most recent commit 3 months ago
Pretrained Language Model ⭐ 2,912
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
most recent commit 3 months ago
Repvgg ⭐ 2,882
RepVGG: Making VGG-style ConvNets Great Again
most recent commit a year ago
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141most recent commit 3 months agopypi deepsparse-nightly} Downloads
Pocketflow ⭐ 2,553
An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.
most recent commit 3 years ago
Pytorch Playground ⭐ 2,366
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
most recent commit a year ago
Mixtral Offloading ⭐ 1,943
Run Mixtral-8x7B models in Colab or consumer desktops
most recent commit 3 months ago
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53most recent commit 3 months agopypi optimum} Downloads
Neural Compressor ⭐ 1,773
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
dependent packages 15total releases 26most recent commit 3 months agopypi neural-compressor} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Paddleslim ⭐ 1,486
PaddleSlim is an open-source library for deep model compression and architecture search.
dependent packages 4total releases 22most recent commit 3 months agopypi paddleslim} Downloads
Model Optimization ⭐ 1,445
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
dependent packages 27total releases 30most recent commit 4 months agopypi tensorflow-model-optimization} Downloads
Mmrazor ⭐ 1,231
OpenMMLab Model Compression Toolbox and Benchmark.
dependent packages 2total releases 8most recent commit 5 months agopypi mmrazor} Downloads
Intel Extension For Pytorch ⭐ 1,161
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
dependent packages 12total releases 13most recent commit 3 months agopypi intel-extension-for-pytorch} Downloads
Brevitas ⭐ 1,015
Brevitas: neural network quantization in PyTorch
dependent packages 2total releases 13most recent commit 3 months agopypi brevitas} Downloads
Ppq ⭐ 957
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
most recent commit 10 months ago
Nncf ⭐ 725
Neural Network Compression Framework for enhanced OpenVINO™ inference
dependent packages 6total releases 16most recent commit 3 months agopypi nncf} Downloads
Deepvac ⭐ 618
PyTorch Project Specification.
total releases 59most recent commit 3 years ago
Deep Compression Alexnet ⭐ 599
Deep Compression on AlexNet
most recent commit 2 years ago
Kill The Bits ⭐ 582
Code for: "And the bit goes down: Revisiting the quantization of neural networks"
most recent commit 3 years ago
Qkeras ⭐ 514
QKeras: a quantization deep learning library for Tensorflow Keras
dependent packages 2total releases 1most recent commit 3 months agopypi QKeras} Downloads
The 10 Most Depended On Python Quantization Open Source Projects
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months agopypi optimum} Downloads
Model Optimization ⭐ 1,445
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
dependent packages 27total releases 30latest release May 26, 2023most recent commit 4 months agopypi tensorflow-model-optimization} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160latest release December 06, 2023most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Intel Extension For Pytorch ⭐ 1,161
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
dependent packages 12total releases 13latest release October 19, 2023most recent commit 3 months agopypi intel-extension-for-pytorch} Downloads
Sparsezoo ⭐ 347
Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
dependent packages 7total releases 26latest release December 04, 2023most recent commit 3 months agopypi sparsezoo} Downloads
Nncf ⭐ 725
Neural Network Compression Framework for enhanced OpenVINO™ inference
dependent packages 6total releases 16latest release November 16, 2023most recent commit 3 months agopypi nncf} Downloads
Paddleslim ⭐ 1,486
PaddleSlim is an open-source library for deep model compression and architecture search.
dependent packages 4total releases 22latest release December 29, 2022most recent commit 3 months agopypi paddleslim} Downloads
Navec ⭐ 140
Compact high quality word embeddings for Russian language
dependent packages 4total releases 9latest release October 29, 2020most recent commit 9 months agopypi navec} Downloads
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141latest release December 07, 2023most recent commit 3 months agopypi deepsparse-nightly} Downloads
The 10 Latest Releases In Python Quantization Open Source Projects
Sparsify ⭐ 310
ML model optimization product to accelerate inference.
total releases 136latest release December 11, 2023most recent commit 4 months ago
Brevitas ⭐ 1,015
Brevitas: neural network quantization in PyTorch
dependent packages 2total releases 13latest release December 08, 2023most recent commit 3 months agopypi brevitas} Downloads
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141latest release December 07, 2023most recent commit 3 months agopypi deepsparse-nightly} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160latest release December 06, 2023most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months agopypi optimum} Downloads
Sparsezoo ⭐ 347
Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
dependent packages 7total releases 26latest release December 04, 2023most recent commit 3 months agopypi sparsezoo} Downloads
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19latest release December 03, 2023most recent commit 3 months ago
Nncf ⭐ 725
Neural Network Compression Framework for enhanced OpenVINO™ inference
dependent packages 6total releases 16latest release November 16, 2023most recent commit 3 months agopypi nncf} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.