Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for llamacpp
llamacpp
x
100 search results found
Llama Gpt
⭐
9,682
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Jan
⭐
8,009
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
Serge
⭐
5,390
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
Agixt
⭐
2,267
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
Llamasharp
⭐
1,348
Run local LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp.
Nitro
⭐
1,115
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Llamachat
⭐
1,011
Chat with your favourite LLaMA models in a native macOS app
Llama Node
⭐
846
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
Modelfusion
⭐
712
The TypeScript library for building AI applications.
Swiss_army_llama
⭐
688
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Floneum
⭐
505
A toolkit for controllable, private AI on consumer hardware in rust
Llavavision
⭐
409
A simple "Be My Eyes" web app with a llama.cpp/llava backend
Gpu_poor
⭐
371
Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization
Twinny
⭐
368
The most no-nonsense locally hosted (or API hosted) AI code completion plugin for vs-code, like GitHub Copilot but 100% free and 100% private.
Vicuna Installation Guide
⭐
258
The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B
Codeqai
⭐
243
Local first semantic code search and chat powered by vector embeddings and LLMs
Realtime Bakllava
⭐
226
llama.cpp with BakLLaVA model describes what does it see
Casalioy
⭐
221
♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Gptme
⭐
172
A CLI and web UI to interact with LLMs in a Chat-style interface, with code execution capabilities.
Vit.cpp
⭐
135
Inference Vision Transformer (ViT) in plain C/C++ with ggml
Inferflow
⭐
135
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
Llmunity
⭐
130
Integrate LLM models in Unity!
Ialacol
⭐
127
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
Code Llama For Vscode
⭐
120
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
Llama Cpp Agent
⭐
114
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama-cpp-python, allowing users to chat with LLM models, execute structured function calls and get structured output.
Llm Api
⭐
109
Run any Large Language Model behind a unified API
Collider
⭐
98
Large Model Collider - The Platform for serving LLM models
Aub.ai
⭐
95
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
Comfyui N Nodes
⭐
90
A suite of custom nodes for ConfyUI that includes GPT text-prompt generation, LoadVideo, SaveVideo, LoadFramesFromFolder and FrameInterpolator
Hackbot
⭐
79
AI-powered cybersecurity chatbot designed to provide helpful and accurate answers to your cybersecurity-related queries and also do code analysis and scan analysis.
Chat Llama Discord Bot
⭐
78
A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.
Neural Speed
⭐
77
An innovation library for efficient LLM inference via low-bit quantization and sparsity
Text Generation Webui Telegram_bot
⭐
76
LLM telegram bot
Erudito
⭐
70
Erudito: Easy API/CLI to ask questions about your documentation
Reor
⭐
61
Private AI-powered personal knowledge management tool with a focus on running models locally.
Cappr
⭐
57
Completion After Prompt Probability. Make your LLM make a choice
Signal Aichat
⭐
46
An AI chatbot for Signal powered by Google Bard, Bing Chat, ChatGPT, HuggingChat, and llama.cpp
Cortex
⭐
40
Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.
Privatedocbot
⭐
39
📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy
Llama Server
⭐
38
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Assistant
⭐
37
An intellligent AI assistant that can do anything!
Localagi
⭐
36
LocalAGI:Locally run AGI powered by LLaMA, ChatGLM and more. | 基于 ChatGLM, LLaMA 大模型的本地运行的 AGI
Magi_llm_gui
⭐
35
A Qt GUI for large language models
Llama Api
⭐
34
An OpenAI-like LLaMA inference API
Ai.labs
⭐
33
openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel
Llama.net
⭐
33
.NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙
Instruct Ner
⭐
30
Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)
Llm.f90
⭐
30
LLM inference in Fortran
Mac Ml Speed Test
⭐
27
A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
Llm_server
⭐
26
Rack API application for Llama.cpp
Api
⭐
25
GPTStonks FastAPI repo
Baby Code
⭐
24
100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙
Py.gpt.prompt
⭐
23
PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-term memory and task automation.
Botality Ii
⭐
23
telegram bot for stable diffusion, text-to-speech and large language models, such as llama and alpaca
Llm Prompt Templates
⭐
22
Empower your LLM to do more than you ever thought possible with these state-of-the-art prompt templates.
Companionllm
⭐
21
CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion
Vision Core Ai
⭐
21
Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.
Pacha
⭐
21
"Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.
Translate Shell
⭐
20
Translate text by google, bing, youdaozhiyun, haici, stardict, openai, large language model of local machine, etc at same time from CLI, GUI (GNU/Linux, Android, macOS and Windows), REPL, python, shell and vim.
Llama.sh
⭐
20
No-messing-around sh client for llama.cpp's server
Llamastack
⭐
19
ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
Gguf.js
⭐
18
A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
Llm_telegram_bot
⭐
18
Connect llama-cpp, transformers or text-generation-webui to telegram bot api.
Exa
⭐
17
Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve.
Machine Learning
⭐
17
A set of jupyter notebooks
Local Chat
⭐
17
LocalChat is a ChatGPT-like chat that runs on your computer
Tldwol
⭐
16
Web API that summarizes multimedia from various sources using modern AI tools.
Sam Assistant
⭐
15
🤖 Sam-assistant is a personal assistant that is designed to understand your documents, search the internet, and in future versions, create and understand images, and communicate with you. It is built in Python, mainly using Langchain and implements most of Langchain
Llama Cpp Guidance
⭐
12
A guidance compatibility layer for llama-cpp-python
Altaeraai
⭐
11
A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
Chap
⭐
11
chap - A Python interface to chatgpt, including a terminal user interface (tui)
Llamagotchi
⭐
10
A bunch of LLaMa model investigations, including recreating generative agents (from the paper Generative Agents: Interactive Simulacra of Human Behavior)
Llm_json_schema
⭐
10
Guaranty the output of an LLM to follow a json schema.
Eucalyptus Chat
⭐
9
A frontend for large language models like 🐨 Koala or 🦙 Vicuna running on CPU with llama.cpp, using the API server library provided by llama-cpp-python.
Convokit
⭐
9
Make SwiftUI apps more accessible + powerful with conversation
Openserver
⭐
9
Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.
Ai Messenger
⭐
9
A QT GUI for large language models
My Llama
⭐
8
Go bindings for llama.cpp and webui
Llama
⭐
8
Modelfusion Llamacpp Nextjs Starter
⭐
8
Starter examples for using Next.js and the Vercel AI SDK with Llama.cpp and ModelFusion.
Llama Server Chat Terminal Client
⭐
8
Lightweight chat terminal-interface for llama.cpp server compilable for windows and linux.
Chat Llama Bot
⭐
8
Rendezllama
⭐
8
CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
Retrieval Augmented Qa
⭐
7
Query, ask and chat with a document-index via transformer models!
Llama Playground
⭐
7
A simple to use and powerful web-interface to mess around with Meta's LLaMA LLM.
Jeff
⭐
7
Chatbot and automation tool
Chitchat
⭐
7
Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)
Personalgpt
⭐
7
Your own GPT-powered Personal Assistant to whom you can ORDER or INSTRUCT to do some task or search for something using your VOICE commands.
Ai Chatbot
⭐
7
AI Chatbot with Streamlit, Langchain, and Mistral7b
Uni Llm Voice Chat
⭐
6
This project uses llama.cpp as an LLM server to perform inference and generate speech using Synthetic voice library
Worldstory Ai
⭐
6
WroldStory-AI is a project that creates and interacts with fictional characters
Autocompleter
⭐
6
Auto Complete anything using a gguf model
Ein Llm
⭐
5
A self-hosted personal chatbot API with FastAPI. It allows you to interact with the Llama2 LLM (and other open-source LLMs) to have natural language conversations, generate text, and perform various language-related tasks.
Pdf Intellect
⭐
5
PDF Intellect is a smart AI-powered tool designed to extract and analyze information from PDF document
Llama Java
⭐
5
Build your own private GPT service using LLaMA Java.
Vowelreconstruct
⭐
5
An easy to use and understand method for the average user to test various aspects of intelligence of your LLM in only one run.
Llamacpp.net
⭐
5
C#/.NET binding of llama.cpp
Googlecolab
⭐
5
Llm_client
⭐
5
Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.
Llamaterm
⭐
5
Use your open source local model from the terminal
1-100 of 100 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.