Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Quantization Open Source Projects

Open source projects categorized as Quantization
Categories > Machine Learning > Quantization
Chinese Llama Alpaca ⭐ 15,877
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
most recent commit 4 months ago
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19most recent commit 3 months ago
Faster Whisper ⭐ 8,003
Faster Whisper transcription with CTranslate2
dependent packages 22total releases 12most recent commit a month agopypi faster-whisper} Downloads
Mozjpeg ⭐ 5,225
Improved JPEG encoder.
dependent packages 1total releases 2most recent commit 6 months ago
Pngquant ⭐ 4,995
Lossy PNG compressor — pngquant command based on libimagequant library
total releases 5most recent commit 3 months ago
Qbot ⭐ 4,799
[🔥updating ...] AI 自动量化交易机器人 AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant
most recent commit 5 months ago
Distiller ⭐ 4,252
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
most recent commit a year ago
Autogptq ⭐ 3,637
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
most recent commit 18 days ago
Pinto_model_zoo ⭐ 3,121
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
most recent commit 3 months ago
Nlp Architect ⭐ 2,927
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
total releases 10most recent commit a year ago
Pretrained Language Model ⭐ 2,912
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
most recent commit 3 months ago
Repvgg ⭐ 2,882
RepVGG: Making VGG-style ConvNets Great Again
most recent commit a year ago
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141most recent commit 3 months agopypi deepsparse-nightly} Downloads
Pocketflow ⭐ 2,553
An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.
most recent commit 3 years ago
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103most recent commit 3 months agopypi ctranslate2} Downloads
Pytorch Playground ⭐ 2,366
Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)
most recent commit a year ago
Micronet ⭐ 2,165
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/in
total releases 46most recent commit 3 years ago
Mixtral Offloading ⭐ 1,943
Run Mixtral-8x7B models in Colab or consumer desktops
most recent commit 3 months ago
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53most recent commit 3 months agopypi optimum} Downloads
Neural Compressor ⭐ 1,773
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
dependent packages 15total releases 26most recent commit 3 months agopypi neural-compressor} Downloads
Gltf Pipeline ⭐ 1,732
Content pipeline tools for optimizing glTF assets. 🌐
dependent packages 34total releases 45most recent commit 4 months agonpm gltf-pipeline} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Leptonica ⭐ 1,611
Leptonica is an open source library containing software that is broadly useful for image processing and image analysis applications. The official github repository for Leptonica is: danbloomberg/leptonica. See leptonica.org for more documentation.
dependent packages 2total releases 5most recent commit 3 months ago
The 10 Most Depended On Quantization Open Source Projects
Imagemin Mozjpeg ⭐ 227
Imagemin plugin for mozjpeg
dependent packages 578total releases 15latest release December 17, 2021most recent commit 2 years agonpm imagemin-mozjpeg} Downloads
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months agopypi optimum} Downloads
Topojson Server ⭐ 71
Convert GeoJSON to TopoJSON.
dependent packages 49total releases 3latest release September 05, 2019most recent commit 4 years agonpm topojson-server} Downloads
Quantize ⭐ 82
A node.js module for color quantization, based on Leptonica.
dependent packages 43total releases 3latest release April 06, 2016most recent commit 4 years agonpm quantize} Downloads
Gltf Pipeline ⭐ 1,732
Content pipeline tools for optimizing glTF assets. :globe_with_meridians:
dependent packages 34total releases 45latest release April 21, 2023most recent commit 4 months agonpm gltf-pipeline} Downloads
Model Optimization ⭐ 1,445
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
dependent packages 27total releases 30latest release May 26, 2023most recent commit 3 months agopypi tensorflow-model-optimization} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160latest release December 06, 2023most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Faster Whisper ⭐ 8,003
Faster Whisper transcription with CTranslate2
dependent packages 22total releases 12latest release November 26, 2023most recent commit a month agopypi faster-whisper} Downloads
The 10 Latest Releases In Quantization Open Source Projects
Sparsify ⭐ 310
ML model optimization product to accelerate inference.
total releases 136latest release December 11, 2023most recent commit 4 months ago
Brevitas ⭐ 1,015
Brevitas: neural network quantization in PyTorch
dependent packages 2total releases 13latest release December 08, 2023most recent commit 3 months agopypi brevitas} Downloads
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141latest release December 07, 2023most recent commit 3 months agopypi deepsparse-nightly} Downloads
Vector Quantize Pytorch ⭐ 1,627
Vector Quantization, in Pytorch
dependent packages 25total releases 160latest release December 06, 2023most recent commit 3 months agopypi vector-quantize-pytorch} Downloads
Optimum ⭐ 1,908
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
dependent packages 53total releases 53latest release December 06, 2023most recent commit 3 months agopypi optimum} Downloads
Ctranslate2 ⭐ 2,437
Fast inference engine for Transformer models
dependent packages 23total releases 103latest release December 05, 2023most recent commit 3 months agopypi ctranslate2} Downloads
Sparsezoo ⭐ 347
Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
dependent packages 7total releases 26latest release December 04, 2023most recent commit 3 months agopypi sparsezoo} Downloads
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19latest release December 03, 2023most recent commit 3 months ago
Mozjpeg ⭐ 5,225
Improved JPEG encoder.
dependent packages 1total releases 2latest release December 01, 2023most recent commit 6 months ago
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.