Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

Llama.onnx

LLaMa/RWKV onnx models, quantization and testcase
Stars
196
License
gpl-3.0
Open Issues
11
Most Recent Commit
10 months ago
Programming Language
Python
Categories
Repo
Alternatives To Llama.onnx
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Distiller4,252
a year ago65apache-2.0Jupyter Notebook
Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller
Pinto_model_zoo3,121
3 months ago11mitPython
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
Deepsparse2,729pypi deepsparse-nightly} Downloads33 months ago141December 07, 202328otherPython
Sparsity-aware deep learning inference runtime for CPUs
Micronet2,177
3 years ago46October 06, 202170mitPython
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
Optimum1,908pypi optimum} Downloads533 months ago53December 06, 2023295apache-2.0Python
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
Ppq957
10 months ago9apache-2.0Python
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
Nncf725pypi nncf} Downloads63 months ago16November 16, 202346apache-2.0Python
Neural Network Compression Framework for enhanced OpenVINO™ inference
Deepvac618
3 years ago59June 28, 202112gpl-3.0Python
PyTorch Project Specification.
Onnx2tf461pypi onnx2tf} Downloads23 months ago438December 10, 202314mitPython
Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massive Transpose extrapolation problem in onnx-tensorflow (onnx-tf). I don't need a Star, but give me a pull request.
Onnx2tflite422
6 months ago10apache-2.0Python
Tool for onnx->keras or onnx->tflite. If tool is useful for you, please star it.
Alternatives To Llama.onnx
Select To Compare
Deepsparse ⭐ 2,729
Sparsity-aware deep learning inference runtime for CPUs
dependent packages 3total releases 141most recent commit 3 months agopypi deepsparse-nightly} Downloads
Nncf ⭐ 725
Neural Network Compression Framework for enhanced OpenVINO™ inference
dependent packages 6total releases 16most recent commit 3 months agopypi nncf} Downloads
Deepvac ⭐ 618
PyTorch Project Specification.
total releases 59most recent commit 3 years ago


Suggest An Alternative To llama.onnx
Alternative Project Comparisons
Llama.onnx vs Distiller
Llama.onnx vs Pinto_model_zoo
Llama.onnx vs Deepsparse
Llama.onnx vs Micronet
Llama.onnx vs Optimum
Llama.onnx vs Ppq
Llama.onnx vs Nncf
Llama.onnx vs Deepvac
Llama.onnx vs Onnx2tf
Llama.onnx vs Onnx2tflite
Popular Quantization Projects
Llama Factory ⭐ 10,715
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
total releases 19latest release December 03, 2023most recent commit 3 months ago
Faster Whisper ⭐ 8,711
Faster Whisper transcription with CTranslate2
dependent packages 22total releases 12latest release November 26, 2023most recent commit 22 days agopypi faster-whisper} Downloads
Mozjpeg ⭐ 5,225
Improved JPEG encoder.
dependent packages 1total releases 2latest release December 01, 2023most recent commit 7 months ago
Pngquant ⭐ 4,995
Lossy PNG compressor — pngquant command based on libimagequant library
total releases 5latest release November 13, 2022most recent commit 3 months ago
Popular Onnx Projects
Yolov5 ⭐ 44,755
YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite
dependent packages 2total releases 3latest release June 08, 2022most recent commit 3 months agopypi ultralytics-yolov5} Downloads
Netron ⭐ 26,068
Visualizer for neural network, deep learning and machine learning models
dependent packages 70total releases 610latest release December 09, 2023most recent commit 10 days agopypi netron} Downloads
Ncnn ⭐ 19,097
ncnn is a high-performance neural network inference framework optimized for the mobile platform
dependent packages 1total releases 26latest release October 27, 2023most recent commit 25 days agopypi ncnn} Downloads
Onnx ⭐ 16,275
Open standard for machine learning interoperability
dependent packages 493total releases 31latest release October 26, 2023most recent commit 3 months agopypi onnx} Downloads
Clip As Service ⭐ 12,160
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
dependent packages 14total releases 56latest release December 20, 2019most recent commit 3 months agopypi bert-serving-client} Downloads
Popular Machine Learning Categories
Deep Learning
Machine Learning
Pytorch
Tensorflow
Natural Language Processing
Neural Network
Neural
Computer Vision
Convolutional Neural Networks
Opencv
Related Searches
Python Onnx
Python Quantization
Onnx Onnxruntime
Python Onnxruntime
Python Llama
Python Alpaca
Llama Alpaca
Onnx Quantization
Quantization Onnxruntime

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Onnx
Quantization
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.