Awesome Open Source

Programming Languages

Search results for llamacpp ggml

9 search results found

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Vit.cpp ⭐ 135

Inference Vision Transformer (ViT) in plain C/C++ with ggml

Ialacol ⭐ 127

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Collider ⭐ 98

Large Model Collider - The Platform for serving LLM models

Py.gpt.prompt ⭐ 23

PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Altaeraai ⭐ 11

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

Autocompleter ⭐ 6

Auto Complete anything using a gguf model

Llm_client ⭐ 5

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Related Searches

Python Llamacpp (68)

Llm Llamacpp (64)

Artificial Intelligence Llamacpp (30)

Openai Llamacpp (20)

Artificial Intelligence Ggml (19)

Python Ggml (12)

Llamacpp Llama Cpp (12)

Llama Ggml (11)

Machine Learning Ggml (8)

1-9 of 9 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.