Static_bfp_cnn

Static Block Floating Point Quantization for CNN
Alternatives To Static_bfp_cnn
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Distiller4,252
a year ago65apache-2.0Jupyter Notebook
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
Autogptq3,206
2 months ago174mitPython
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Pinto_model_zoo3,121
2 months ago11mitPython
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
Nlp Architect2,926
a year ago10April 12, 202014apache-2.0Python
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
Pytorch Playground2,366
a year ago9mitPython
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
Micronet2,155
2 years ago46October 06, 202170mitPython
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
Mixtral Offloading1,943
2 months ago12mitPython
Run Mixtral-8x7B models in Colab or consumer desktops
Optimum1,908532 months ago53December 06, 2023295apache-2.0Python
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
Vector Quantize Pytorch1,627252 months ago160December 06, 202327mitPython
Vector Quantization, in Pytorch
Mmrazor1,23124 months ago8May 04, 2022133apache-2.0Python
OpenMMLab Model Compression Toolbox and Benchmark.
Alternatives To Static_bfp_cnn
Select To Compare


Alternative Project Comparisons
Popular Quantization Projects
Popular Pytorch Projects
Popular Machine Learning Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pytorch
Convolutional Neural Networks
Deep Neural Networks
Resnet
Imagenet
Quantization