Bitpack

BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.
Alternatives To Bitpack
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Distiller4,252
a year ago65apache-2.0Jupyter Notebook
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
Autogptq3,637
24 days ago174mitPython
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Pinto_model_zoo3,121
3 months ago11mitPython
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
Nlp Architect2,927
a year ago10April 12, 202014apache-2.0Python
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
Pytorch Playground2,366
a year ago9mitPython
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
Micronet2,177
3 years ago46October 06, 202170mitPython
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
Mixtral Offloading1,943
3 months ago12mitPython
Run Mixtral-8x7B models in Colab or consumer desktops
Optimum1,908533 months ago53December 06, 2023295apache-2.0Python
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
Vector Quantize Pytorch1,627253 months ago160December 06, 202327mitPython
Vector Quantization, in Pytorch
Mmrazor1,23125 months ago8May 04, 2022133apache-2.0Python
OpenMMLab Model Compression Toolbox and Benchmark.
Alternatives To Bitpack
Select To Compare


Alternative Project Comparisons
Popular Pytorch Projects
Popular Quantization Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pytorch
Quantization
Model Compression