Awesome Open Source

Programming Languages

Search results for llm llamacpp

56 search results found

Llama Gpt ⭐ 9,682

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

Agixt ⭐ 2,267

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Llamasharp ⭐ 1,348

Run local LLaMA/GPT model easily and fast in C#!🤗 It's also easy to integrate LLamaSharp with semantic-kernel, unity, WPF and WebApp.

Nitro ⭐ 1,115

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Llama Node ⭐ 846

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

Modelfusion ⭐ 712

The TypeScript library for building AI applications.

Floneum ⭐ 505

A toolkit for controllable, private AI on consumer hardware in rust

Llavavision ⭐ 409

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Vicuna Installation Guide ⭐ 258

The "vicuna-installation-guide" provides step-by-step instructions for installing and configuring Vicuna 13 and 7B

Codeqai ⭐ 243

Local first semantic code search and chat powered by vector embeddings and LLMs

Realtime Bakllava ⭐ 226

llama.cpp with BakLLaVA model describes what does it see

Casalioy ⭐ 221

♾️ toolkit for air-gapped LLMs on consumer-grade hardware

A CLI and web UI to interact with LLMs in a Chat-style interface, with code execution capabilities.

Llmunity ⭐ 130

Integrate LLM models in Unity!

Ialacol ⭐ 127

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Code Llama For Vscode ⭐ 120

Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

Llama Cpp Agent ⭐ 114

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama-cpp-python, allowing users to chat with LLM models, execute structured function calls and get structured output.

Llm Api ⭐ 109

Run any Large Language Model behind a unified API

Collider ⭐ 98

Large Model Collider - The Platform for serving LLM models

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Chat Llama Discord Bot ⭐ 78

A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.

Text Generation Webui Telegram_bot ⭐ 76

LLM telegram bot

Simplify and accelerate AI-powered application development with structured interfaces to models and powerful prompt execution environments.

Privatedocbot ⭐ 39

📚 Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy

Assistant ⭐ 37

An intellligent AI assistant that can do anything!

Localagi ⭐ 36

LocalAGI：Locally run AGI powered by LLaMA, ChatGLM and more. ｜基于 ChatGLM, LLaMA 大模型的本地运行的 AGI

Magi_llm_gui ⭐ 35

A Qt GUI for large language models

openai chatgpt or local llm(llama.cpp gguf format)+TTS+STT+Word+Excel

LLM inference in Fortran

Mac Ml Speed Test ⭐ 27

A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

Llm_server ⭐ 26

Rack API application for Llama.cpp

GPTStonks FastAPI repo

Llm Prompt Templates ⭐ 22

Empower your LLM to do more than you ever thought possible with these state-of-the-art prompt templates.

Companionllm ⭐ 21

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

"Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.

Llamastack ⭐ 19

ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Local Chat ⭐ 17

LocalChat is a ChatGPT-like chat that runs on your computer

Sam Assistant ⭐ 15

🤖 Sam-assistant is a personal assistant that is designed to understand your documents, search the internet, and in future versions, create and understand images, and communicate with you. It is built in Python, mainly using Langchain and implements most of Langchain

Llama Cpp Guidance ⭐ 12

A guidance compatibility layer for llama-cpp-python

chap - A Python interface to chatgpt, including a terminal user interface (tui)

Llm_json_schema ⭐ 10

Guaranty the output of an LLM to follow a json schema.

Llamagotchi ⭐ 10

A bunch of LLaMa model investigations, including recreating generative agents (from the paper Generative Agents: Interactive Simulacra of Human Behavior)

Openserver ⭐ 9

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Rendezllama ⭐ 8

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

Modal LLM LLama.cpp based model deployment as part of series of Model as a Service (MaaS)

Personalgpt ⭐ 7

Your own GPT-powered Personal Assistant to whom you can ORDER or INSTRUCT to do some task or search for something using your VOICE commands.

Ai Chatbot ⭐ 7

AI Chatbot with Streamlit, Langchain, and Mistral7b

Autocompleter ⭐ 6

Auto Complete anything using a gguf model

Llama Java ⭐ 5

Build your own private GPT service using LLaMA Java.

Llm_client ⭐ 5

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Llamacpp.net ⭐ 5

C#/.NET binding of llama.cpp

Googlecolab ⭐ 5

Vowelreconstruct ⭐ 5

An easy to use and understand method for the average user to test various aspects of intelligence of your LLM in only one run.

Related Searches

Python Llm (1,377)

Artificial Intelligence Llm (699)

Openai Llm (569)

Chatgpt Llm (533)

Natural Language Processing Llm (285)

Llm Llama (269)

Typescript Llm (258)

Jupyter Notebook Llm (253)

Machine Learning Llm (214)

1-56 of 56 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.