Awesome Open Source

Programming Languages

Search results for gguf

13 search results found

Nitro ⭐ 1,115

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Node Llama Cpp ⭐ 385

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

UI for 🦙model . Run AI assistant locally ✨

Gguf Tools ⭐ 146

GGUF implementation in C as a library and a tools CLI program

Llm.swift ⭐ 100

LLM.swift is a simple, and readable library which lets you locally interact with LLMs with ease for macOS, iOS, visionOS, watchOS, and tvOS.

Shady.ai ⭐ 80

Making offline AI models accessible to all types of edge devices.

😈 ImpAI is an advanced role play app using large language and diffusion models.

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Cog Models ⭐ 17

A collection of cog models for use on Replicate

Alpaca Electron Zephyrine ⭐ 12

Introducing Project Zephyrine: Elevating Your Interaction Experience with LLM (LLaMa, LLaMA-2, Falcon), Harnessing the Power of GGML v2, GGML v3, GGUF, and Employing GPU Acceleration within a Modernized Alpaca Electron Chatbot Local Graphical User Interface.

Altaeraai ⭐ 11

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

Llama Cpp Chat Memory ⭐ 11

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

Gguf Tools ⭐ 5

Some random tools for working with the GGUF file format

Related Searches

Artificial Intelligence Gguf (8)

Llamacpp Gguf (6)

Python Gguf (5)

Machine Learning Gguf (4)

Llama2 Gguf (4)

Typescript Gguf (3)

Chatgpt Gguf (3)

1-13 of 13 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.