Awesome Open Source

Programming Languages

Search results for c plus plus llamacpp

8 search results found

Nitro ⭐ 1,115

A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API

Realtime Bakllava ⭐ 226

llama.cpp with BakLLaVA model describes what does it see

Inferflow ⭐ 135

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

Vit.cpp ⭐ 135

Inference Vision Transformer (ViT) in plain C/C++ with ggml

Neural Speed ⭐ 77

An innovation library for efficient LLM inference via low-bit quantization and sparsity

Go bindings for llama.cpp and webui

Rendezllama ⭐ 8

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

Llama Server Chat Terminal Client ⭐ 8

Lightweight chat terminal-interface for llama.cpp server compilable for windows and linux.

Chatbot and automation tool

Llama Java ⭐ 5

Build your own private GPT service using LLaMA Java.

Related Searches

C Plus Plus Cmake (8,554)

C Plus Plus Qt (8,362)

C Plus Plus Video Game (8,255)

Python C Plus Plus (6,700)

C Plus Plus Algorithms (6,194)

C Plus Plus Opengl (4,396)

C Plus Plus 3d Graphics (3,196)

C Plus Plus Testing (2,735)

Java C Plus Plus (2,664)

C Plus Plus Command Line (2,304)

1-8 of 8 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.