Awesome Open Source

Programming Languages

Search results for llm ggml

21 search results found

An ecosystem of Rust libraries for working with large language models

Inference ⭐ 1,584

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Rwkv.cpp ⭐ 956

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Gpu_poor ⭐ 371

Calculate GPU memory requirement & breakdown for training/inference of LLM models. Supports ggml/bnb quantization

Can Ai Code ⭐ 364

Self-evaluating interview for AI coders

Llama Cult And More ⭐ 323

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Ialacol ⭐ 127

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Collider ⭐ 98

Large Model Collider - The Platform for serving LLM models

Llama_ros ⭐ 69

llama.cpp for ROS 2

Customchar ⭐ 51

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

Private Chatbot Mpt30b Langchain ⭐ 48

Chat with your data privately using MPT-30b

Zicklein ⭐ 28

Finetuning instruct-LLaMA on german datasets.

😈 ImpAI is an advanced role play app using large language and diffusion models.

✨ Your Custom Offline Role Play with LLM and Stable Diffusion on Mac and Linux (for now) 🧙‍♂️

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Alpaca Electron Zephyrine ⭐ 12

Introducing Project Zephyrine: Elevating Your Interaction Experience with LLM (LLaMa, LLaMA-2, Falcon), Harnessing the Power of GGML v2, GGML v3, GGUF, and Employing GPU Acceleration within a Modernized Alpaca Electron Chatbot Local Graphical User Interface.

pure go for rwkv

Autocompleter ⭐ 6

Auto Complete anything using a gguf model

Simplechat_llama2_mac_silicon ⭐ 6

A simple chat app with embeddings and vector database, exclusively for local execution on mac/apple silicon.

Llm_client ⭐ 5

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

Gguf Tools ⭐ 5

Some random tools for working with the GGUF file format

Related Searches

Python Llm (1,377)

Artificial Intelligence Llm (719)

Openai Llm (569)

Chatgpt Llm (533)

Natural Language Processing Llm (285)

Llm Llama (269)

Typescript Llm (258)

Machine Learning Llm (214)

Llm Large Language Models (213)

1-21 of 21 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.