Gpu_poor

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization
Alternatives To Gpu_poor
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Ctranslate22,437233 months ago103December 05, 2023110mitC++
Fast inference engine for Transformer models
Gpu_poor371
6 months ago1JavaScript
Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization
Terngrad152
5 years ago6apache-2.0Python
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
Easy Translate128
5 months ago3apache-2.0Python
Easy-Translate is a script for translating large text files with a SINGLE COMMAND. Easy-Translate is designed to be as easy as possible for beginners and as seamlesscustomizable and as possible for advanced users.
Meshopt Rs118
13 months ago10November 03, 20191apache-2.0Rust
Rust ffi and idiomatic wrapper for zeux/meshoptimizer, a mesh optimization library that makes indexed meshes more GPU-friendly.
Product Quantization Tree78
5 years ago5mitCuda
GPU-based large scale Approx. Nearest Neighbor Search, accepted at CVPR 2016
Local Search Quantization65
6 years agomitJulia
State-of-the-art method for large-scale ANN search as of Oct 2016. Presented at ECCV 16.
Unq16
5 years agoC++
Supplementary Code for Unsupervised Neural Quantization for Compressed-Domain Similarity Search
Alternatives To Gpu_poor
Select To Compare


Alternative Project Comparisons
Popular Quantization Projects
Popular Gpu Projects
Popular Machine Learning Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Javascript
Pytorch
Gpu
Language Model
Quantization