The Top 182 Quantization Open Source Projects on Github

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 9

Application Programming Interfaces 📦 120

Applications 📦 181

Artificial Intelligence 📦 72

Blockchain 📦 70

Build Tools 📦 111

Cloud Computing 📦 79

Code Quality 📦 28

Collaboration 📦 30

Command Line Interface 📦 48

Community 📦 81

Companies 📦 60

Compilers 📦 60

Computer Science 📦 74

Configuration Management 📦 39

Content Management 📦 167

Control Flow 📦 197

Data Formats 📦 77

Data Processing 📦 266

Data Storage 📦 132

Economics 📦 60

Frameworks 📦 198

Graphics 📦 103

Hardware 📦 148

Integrated Development Environments 📦 47

Learning Resources 📦 147

Libraries 📦 119

Lists Of Projects 📦 21

Machine Learning 📦 336

Mapping 📦 61

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 97

Networking 📦 304

Operating Systems 📦 84

Operations 📦 120

Package Managers 📦 52

Programming Languages 📦 229

Runtime Environments 📦 96

Science 📦 42

Security 📦 375

Social Media 📦 26

Software Architecture 📦 70

Software Development 📦 68

Software Performance 📦 57

Software Quality 📦 127

Text Editors 📦 45

Text Processing 📦 131

User Interface 📦 310

User Interface Components 📦 465

Version Control 📦 29

Virtualization 📦 68

Web Browsers 📦 38

Web Servers 📦 25

Web User Interface 📦 194

The Top 182 Quantization Open Source Projects on Github

Categories > Machine Learning > Quantization

Pngquant ⭐ 4,053

Lossy PNG compressor — pngquant command based on libimagequant library

Distiller ⭐ 3,489

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Nlp Architect ⭐ 2,729

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Pytorch Playground ⭐ 2,161

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

Pretrained Language Model ⭐ 1,994

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Micronet ⭐ 1,505

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

Model Optimization ⭐ 1,163

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

Training_extensions ⭐ 965

Trainable models and NN optimization tools

Paddleslim ⭐ 820

PaddleSlim is an open-source library for deep model compression and architecture search.

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Awesome Automl And Lightweight Models ⭐ 647

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

Awesome Emdl ⭐ 573

Embedded and mobile deep learning research resources

Brevitas ⭐ 548

Brevitas: quantization-aware training in PyTorch

Deephash ⭐ 457

An Open-Source Package for Deep Learning to Hash (DeepHash)

Libimagequant ⭐ 387

Palette quantization library that powers pngquant and other PNG optimizers

Neural Network Compression Framework for enhanced OpenVINO™ inference

Dataflow compiler for QNN inference on FPGAs

QKeras: a quantization deep learning library for Tensorflow Keras

Deepsparse ⭐ 344

Neural network inference engine that delivers GPU-class performance for sparsified models on CPUs

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Deephash Papers ⭐ 300

Must-read papers on deep learning to hash (DeepHash)

[CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision

Neural Compressor ⭐ 244

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

Blueoil ⭐ 243

Bring Deep Learning to small devices

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Deepvac ⭐ 230

PyTorch Project Specification.

Ctranslate2 ⭐ 211

Fast inference engine for Transformer models

Lq Nets ⭐ 200

LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks

Awesome Ml Model Compression ⭐ 187

Awesome machine learning model compression research papers, tools, and learning material.

Awesome Ai Infrastructures ⭐ 171

Infrastructures™ for Machine Learning Training/Inference in Production.

Model_compression ⭐ 160

PyTorch Model Compression

Terngrad ⭐ 152

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

Awesome Edge Machine Learning ⭐ 151

A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.

Inq Pytorch ⭐ 131

A PyTorch implementation of "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights"

Sparsify ⭐ 128

Easy-to-use UI for automatically sparsifying neural networks and creating sparsification recipes for better inference performance and a smaller footprint

Cnn Quantization ⭐ 126

Quantization of Convolutional Neural networks.

PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

[CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework

Graffitist ⭐ 99

Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow.

Sparsezoo ⭐ 96

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

Powerful, automated analysis and design of quantum microwave chips & devices [Energy-Participation Ratio and more]

Trained Ternary Quantization ⭐ 87

Reducing the size of convolutional neural networks

Frostnet ⭐ 86

FrostNet: Towards Quantization-Aware Network Architecture Search

Jacinto Ai Devkit ⭐ 74

Training & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models

An Open Source Deep Learning Inference Engine Based on FPGA

reference pytorch code for named entity tagging

Stochastic Quantization ⭐ 67

Training Low-bits DNNs with Stochastic Quantization

Compact high quality word embeddings for Russian language

Local Search Quantization ⭐ 65

State-of-the-art method for large-scale ANN search as of Oct 2016. Presented at ECCV 16.

Cvpr17 Dvsq ⭐ 62

The implementation of CVPR-17 paper "Deep Visual-Semantic Quantization of Efficient Image Retrieval"

Colorquant ⭐ 59

Go library for color quantization and dithering

Vectorsinsearch ⭐ 59

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

U Net Fixed Point Quantization For Medical Image Segmentation ⭐ 58

Repository containing code for "U-Net Fixed-Point Quantization for Medical Image Segmentation" paper at MICCAI2019

Image Classification Caltech 256 ⭐ 50

Exploring CNNs and model quantization on Caltech-256 dataset

Bert Squeeze ⭐ 48

🛠️ Tools for Transformers compression using Lightning ⚡

Zaq Code ⭐ 40

CVPR 2021 : Zero-shot Adversarial Quantization (ZAQ)

Iclassifier ⭐ 40

reference pytorch code for intent classification

Tf2deepfloorplan ⭐ 39

A Tensorflow2 implementation of Deep Floor Plan Recognition using a Multi-task Network with Room-boundary-Guided Attention paper. Also supports tensorboard, quantization, tflite, docker, github actions and google colab.

[ICML'21] I-BERT: Integer-only BERT Quantization

Pytorch_quantization ⭐ 38

A pytorch implementation of dorefa quantization

[NeurIPS'2019] Shupeng Gui, Haotao Wang, Haichuan Yang, Chen Yu, Zhangyang Wang, Ji Liu, “Model Compression with Adversarial Robustness: A Unified Optimization Framework”

Image Classification ⭐ 36

A collection of SOTA Image Classification Models in PyTorch

Awesome Quantization And Fixed Point Training ⭐ 35

Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design

pytorch implementation of "Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks"

Camalian ⭐ 31

Library used to deal with colors and images. You can extract colors from images.

Aaai17 Cdq ⭐ 31

The implementation of AAAI-17 paper "Collective Deep Quantization of Efficient Cross-modal Retrieval"

Quantization.mxnet ⭐ 30

Simulate quantization and quantize aware train for MXNet-Gluon models.

Imagecolors ⭐ 29

Use a combination of color quantization algorithms and human fiddling to get human perceivable colors out of an image.

QuaRL is an open-source framework for systematically studying the effect of applying quantization to reinforcement learning algorithms.

Neurips Micronet ⭐ 29

[JMLR 2020] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion

Torch Model Compression ⭐ 28

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

Learning Finite State Representations of Recurrent Policy Networks

SDK for TEE AI Stick (includes model training script, inference library, examples)

Lixinger Openapi ⭐ 27

理杏仁开发平台python api(非官方)

Neural Network Compression ⭐ 25

Paper list for neural network compression techniques

Hailo_model_zoo ⭐ 22

The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment

Model Compression And Acceleration 4 Dnn ⭐ 22

model-compression-and-acceleration-4-DNN

[ECCV 2020] Official repository of "Resolution Switchable Networks for Runtime Efficient Image Recognition" , in PyTorch and TensorFlow

All about acceleration and compression of Deep Neural Networks

Ssd Pruning And Quantization ⭐ 16

Pruning and quantization for SSD. Model compression.

Kgysoft.drawing ⭐ 16

KGy SOFT Drawing is a library for advanced image, icon and graphics handling.

Quantize ⭐ 15

🎨 Simple color palette quantization using MMCQ

Tensorflow Quantization Example ⭐ 14

TensorFlow Quantization Example, for TensorFlow Lite

Mqbench_quantize ⭐ 14

QAT(quantize aware training) for classification with MQBench

Binary Neural Networks ⭐ 14

Exploring "Binary Neural Networks" (https://arxiv.org/abs/1602.02830) in Theano. A set of experiments that use binarised weights and/or activations to reduce computational load of convolutional neural networks.

Pngquant ⭐ 14

A Python Wrapper of Pngquant

BitPack is a practical tool to efficiently save ultra-low precision/mixed-precision quantized models.

Autoencoder_based_image_compression ⭐ 13

Autoencoder based image compression: can the learning be quantization independent? https://arxiv.org/abs/1802.09371

Cnn_on_mcu ⭐ 13

Code for paper: 'Multi-Component Optimization and Efficient Deployment of Neural-Networks on Resource-Constrained IoT Hardware' (paper under review)

Learning To Quantize ⭐ 13

Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.

Kgysoft.drawing.tools ⭐ 11

Debugger visualizers and image editor apps built on KGy SOFT Drawing Libraries

Image Optimizer ⭐ 10

Optimize any image by chroma subsampling and optimized huffman coding in Python.

H264 Encoder ⭐ 10

Implementation of a subset of CBP of h.264 encoder

Quantizedarrays.jl ⭐ 9

Array quantization and compression

Quantized Mobilenetv3 Mnist Android ⭐ 9

Android application recognizing digits using quantized 8-bit MobileNetV3.

Quantized Tensorflow Estimator for Google EdgeTpu Accelerator, Dev Board and Intel Neural Compute Stick 2

[ICLR 2021] "CPT: Efficient Deep Neural Network Training via Cyclic Precision" by Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yining Ding, Vikas Chandra, Yingyan Lin

Integer-only Zero-shot Quantization for Efficient Speech Recognition

Coarsehash ⭐ 7

Benchmark datasets used in ICRA 2020 paper: Fast, Compact and Highly Scalable Visual Place Recognition through Sequence-based Matching of Overloaded Representations

1-100 of 182 projects

Related Projects

Python Quantization Projects (96)

Pytorch Quantization Projects (48)

Quantization Pruning Projects (44)

Deep Learning Quantization Projects (36)

Python Pytorch Quantization Projects (34)

Advertising 📦 9

Application Programming Interfaces 📦 120

Applications 📦 181

Artificial Intelligence 📦 72

Blockchain 📦 70

Build Tools 📦 111

Cloud Computing 📦 79

Code Quality 📦 28

Collaboration 📦 30

Command Line Interface 📦 48

Community 📦 81

Companies 📦 60

Compilers 📦 60

Computer Science 📦 74

Configuration Management 📦 39

Content Management 📦 167

Control Flow 📦 197

Data Formats 📦 77

Data Processing 📦 266

Data Storage 📦 132

Economics 📦 60

Frameworks 📦 198

Graphics 📦 103

Hardware 📦 148

Integrated Development Environments 📦 47

Learning Resources 📦 147

Libraries 📦 119

Lists Of Projects 📦 21

Machine Learning 📦 336

Mapping 📦 61

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 97

Networking 📦 304

Operating Systems 📦 84

Operations 📦 120

Package Managers 📦 52

Programming Languages 📦 229

Runtime Environments 📦 96

Science 📦 42

Security 📦 375

Social Media 📦 26

Software Architecture 📦 70

Software Development 📦 68

Software Performance 📦 57

Software Quality 📦 127

Text Editors 📦 45

Text Processing 📦 131

User Interface 📦 310

User Interface Components 📦 465

Version Control 📦 29

Virtualization 📦 68

Web Browsers 📦 38

Web Servers 📦 25

Web User Interface 📦 194

"GitHub" is a registered trademark of GitHub, Inc. Awesome Open Source is not affiliated with GitHub.

All non readme contents or Github based topics or project metadata copyright Awesome Open Source 2018-2021