The Top 51 Quantization Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 51 Quantization Open Source Projects

Categories > Machine Learning > Quantization

Pngquant ⭐ 3,879

Lossy PNG compressor — pngquant command based on libimagequant library

Distiller ⭐ 3,585

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Nlp Architect ⭐ 2,705

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Pytorch Playground ⭐ 2,130

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

Pretrained Language Model ⭐ 1,798

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Micronet ⭐ 1,415

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

Model Optimization ⭐ 1,080

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

Training_extensions ⭐ 896

Trainable models and NN optimization tools

Paddleslim ⭐ 756

PaddleSlim is an open-source library for deep model compression and architecture search.

Awesome Automl And Lightweight Models ⭐ 717

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Awesome Emdl ⭐ 566

Embedded and mobile deep learning research resources

Burstlinker ⭐ 479

🚀 A simple GIF encoder for Android.

Brevitas ⭐ 459

Brevitas: quantization-aware training in PyTorch

Deephash ⭐ 444

An Open-Source Package for Deep Learning to Hash (DeepHash)

Libimagequant ⭐ 359

Palette quantization library that powers pngquant and other PNG optimizers

Dataflow compiler for QNN inference on FPGAs

QKeras: a quantization deep learning library for Tensorflow Keras

Deephash Papers ⭐ 306

Must-read papers on deep learning to hash (DeepHash)

Neural Network Compression Framework for enhanced OpenVINO™ inference

[CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Blueoil ⭐ 247

Bring Deep Learning to small devices

Awesome Ai Infrastructures ⭐ 244

Infrastructures™ for Machine Learning Training/Inference in Production.

Deepvac ⭐ 218

PyTorch Project Specification.

Lq Nets ⭐ 204

LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks

Awesome Ml Model Compression ⭐ 195

Awesome machine learning model compression research papers, tools, and learning material.

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Ctranslate2 ⭐ 177

Fast inference engine for Transformer models

Model_compression ⭐ 174

PyTorch Model Compression

Deepsparse ⭐ 174

Neural network inference engine that delivers GPU-class performance for sparsified models on CPUs

Terngrad ⭐ 168

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

[CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework

PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.

Cnn Quantization ⭐ 158

Quantization of Convolutional Neural networks.

Inq Pytorch ⭐ 153

A PyTorch implementation of "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights"

Awesome Edge Machine Learning ⭐ 149

A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

Graffitist ⭐ 140

Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow

Model Quantization ⭐ 118

Collections of model quantization algorithms

An Open Source Deep Learning Inference Engine Based on FPGA

Trained Ternary Quantization ⭐ 90

Reducing the size of convolutional neural networks

Powerful, automated analysis and design of quantum microwave chips & devices [Energy-Participation Ratio and more]

Frostnet ⭐ 88

FrostNet: Towards Quantization-Aware Network Architecture Search

pytorch implementation of "Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks"

Vectorsinsearch ⭐ 73

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

Jacinto Ai Devkit ⭐ 70

Training & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models

reference pytorch code for named entity tagging

Quantization.mxnet ⭐ 42

Simulate quantization and quantization aware training for MXNet-Gluon models.

SDK for TEE AI Stick (includes model training script, inference library, examples)

Libimagequant Rust ⭐ 17

libimagequant (pngquant) bindings for the Rust language

1-51 of 51 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210