The Top 51 Quantization Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 51 Quantization Open Source Projects

Categories > Machine Learning > Quantization

Pngquant ⭐ 3,767

Lossy PNG compressor — pngquant command based on libimagequant library

Distiller ⭐ 3,460

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Nlp Architect ⭐ 2,643

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Pytorch Playground ⭐ 2,071

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

Micronet ⭐ 1,273

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

Model Optimization ⭐ 1,027

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

Training_extensions ⭐ 865

Trainable models and NN optimization tools

Paddleslim ⭐ 705

PaddleSlim is an open-source library for deep model compression and architecture search.

Pinto_model_zoo ⭐ 699

A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training quantization (Weight Quantization, Integer Quantization, Full Integer Quantization, Float16 Quantization), Quantization-aware training. TensorFlow Lite. OpenVINO. CoreML. TensorFlow.js. TF-TRT. MediaPipe. ONNX. [.tflite,.h5,.pb,saved_model,tfjs,tftrt,mlmodel,.xml/.bin, .onnx]

Awesome Automl And Lightweight Models ⭐ 695

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

Paddleclas ⭐ 659

A treasure chest for image classification powered by PaddlePaddle

Awesome Emdl ⭐ 558

Embedded and mobile deep learning research resources

Burstlinker ⭐ 479

🚀 A simple GIF encoder for Android.

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Deephash ⭐ 424

An Open-Source Package for Deep Learning to Hash (DeepHash)

Brevitas ⭐ 362

Brevitas: quantization-aware training in PyTorch

Libimagequant ⭐ 347

Palette quantization library that powers pngquant and other PNG optimizers

Deephash Papers ⭐ 300

Must-read papers on deep learning to hash (DeepHash)

Dataflow compiler for QNN inference on FPGAs

QKeras: a quantization deep learning library for Tensorflow Keras

[CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision

Blueoil ⭐ 243

Bring Deep Learning to small devices

PyTorch*-based Neural Network Compression Framework for enhanced OpenVINO™ inference

Awesome Ai Infrastructures ⭐ 229

Infrastructures™ for Machine Learning Training/Inference in Production.

Lq Nets ⭐ 200

LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Awesome Ml Model Compression ⭐ 171

Awesome machine learning model compression research papers, tools, and learning material.

Terngrad ⭐ 168

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

Model_compression ⭐ 159

PyTorch Model Compression

[CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework

Cnn Quantization ⭐ 149

Quantization of Convolutional Neural networks.

Inq Pytorch ⭐ 149

A PyTorch implementation of "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights"

Ctranslate2 ⭐ 148

Fast inference engine for OpenNMT models

PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.

Awesome Edge Machine Learning ⭐ 141

A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.

Graffitist ⭐ 136

Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

Model Quantization ⭐ 118

Collections of model quantization algorithms

An Open Source Deep Learning Inference Engine Based on FPGA

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

Trained Ternary Quantization ⭐ 90

Reducing the size of convolutional neural networks

Deepsparse ⭐ 90

Neural network inference engine that delivers GPU-class performance for sparsified models on CPUs

Frostnet ⭐ 86

FrostNet: Towards Quantization-Aware Network Architecture Search

Powerful, automated analysis and design of quantum microwave chips & devices [Energy-Participation Ratio and more]

pytorch implementation of "Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks"

Vectorsinsearch ⭐ 72

Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Searching with Vectors' talk from Haystack 2019 (US). Builds upon my conceptual search and semantic search work from 2015

reference pytorch code for named entity tagging

Jacinto Ai Devkit ⭐ 55

Training & Quantization of embedded friendly Deep Learning / Machine Learning / Computer Vision models

Quantization.mxnet ⭐ 42

Simulate quantization and quantization aware training for MXNet-Gluon models.

SDK for TEE AI Stick (includes model training script, inference library, examples)

Libimagequant Rust ⭐ 17

libimagequant (pngquant) bindings for the Rust language

1-51 of 51 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210