Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for c plus plus llm
c-plus-plus
x
llm
x
19 search results found
Lmdeploy
⭐
1,762
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Nitro
⭐
1,115
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Rwkv.cpp
⭐
956
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Inferllm
⭐
440
a lightweight LLM model inference framework
Distributed Llama
⭐
292
Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.
Realtime Bakllava
⭐
226
llama.cpp with BakLLaVA model describes what does it see
Glake
⭐
158
GLake: optimizing GPU memory management and IO transmission.
Rtp Llm
⭐
157
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Awadb
⭐
144
AI Native database for embedding vectors
Llava Cpp Server
⭐
116
LLaVA server (llama.cpp).
Llama_cpp.rb
⭐
114
llama_cpp provides Ruby bindings for llama.cpp
Flash_attention_inference
⭐
72
Performance of the C++ interface of flash attention, flash attention v2 and self quantized decoding attention in large language model (LLM) inference scenarios.
Llama_ros
⭐
69
llama.cpp for ROS 2
Customchar
⭐
51
Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.
Redis Llm
⭐
27
redis-llm integrates LLM with Redis. It can help LLM to access private data, and remember long chat history.
Yuna Ai
⭐
24
Your Personal AI Girlfriend
R2ai
⭐
16
local language model for radare2
Llmdatadistill
⭐
12
distill large scale web page text
Rendezllama
⭐
8
CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
Gptj.cpp
⭐
5
Port of GPT-J model in C/C++
Llama Java
⭐
5
Build your own private GPT service using LLaMA Java.
Icpp_llm
⭐
5
on-chain LLMs
Related Searches
C Plus Plus Cmake (8,712)
C Plus Plus Qt (8,557)
C Plus Plus Video Game (8,255)
C Plus Plus Algorithms (6,194)
C Plus Plus Opengl (4,396)
C Plus Plus 3d Graphics (3,196)
C Plus Plus Testing (2,735)
Java C Plus Plus (2,629)
C Plus Plus Command Line (2,304)
Javascript C Plus Plus (2,235)
1-19 of 19 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.