Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for rust llm
llm
x
rust
x
55 search results found
Burn
⭐
7,015
Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.
Llm
⭐
5,358
An ecosystem of Rust libraries for working with large language models
Postgresml
⭐
5,135
The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.
Aichat
⭐
2,091
Use GPT-4(V), Gemini, LocalAI, Ollama and other LLMs in the terminal.
Text Embeddings Inference
⭐
1,566
A blazing fast inference solution for text embeddings models
Smartgpt
⭐
1,466
A program that provides LLMs with the ability to complete complex tasks using plugins.
Aigc
⭐
1,038
《构筑大语言模型应用:应用开发与架构设计》一本关于 LLM 在真实世界应用的开源电子书,介绍了大语言模型的基础知识和应用,以及如何构建自己的模型。其中包括Pro
Pgvecto.rs
⭐
986
Scalable Vector Search in Postgres. Revolutionize Vector Search, not Database.
Trieve
⭐
976
All-in-one infrastructure for building search, recommendations, and RAG. Trieve combines search language models with tools for tuning ranking and relevance.
Llm Chain
⭐
965
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
Mosec
⭐
661
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
Femtogpt
⭐
655
Pure Rust implementation of a minimal Generative Pretrained Transformer
Floneum
⭐
505
A toolkit for controllable, private AI on consumer hardware in rust
Flappy
⭐
283
Production-Ready LLM Agent SDK for Every Developer
Local.ai
⭐
275
🎒 local.ai - Run AI locally on your PC!
Ai00_rwkv_server
⭐
274
A localized open-source AI server that is better than ChatGPT.
Assistants
⭐
268
The ⭐️ Open Source Edge Assistants API allows you to build AI assistants within your own applications with your own models that run on the edge. 75% Cheaper & 23x Faster Assistants. Same API/SDK. Written in Rust
Oatmeal
⭐
223
Terminal UI to chat with large language models (LLM) using different model backends, and integrations with your favourite editors!
Blog
⭐
217
My Tech Blog: about Rust / Golang / Python / Flutter / Blockchain etc.
Infino
⭐
186
Infino - Next-gen OpenSearch Observability. Faster, Cheaper, Smarter.
Fast_vector_similarity
⭐
180
The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.
Plock
⭐
158
Use an LLM from anywhere you can type (uses Ollama by default, but can be used with anything that can write to stdout)
Indexify
⭐
126
A scalable realtime and continuous indexing engine for Unstructured Data to build Generative AI Applications
Speakeasy
⭐
117
Speakeasy CLI - Launch developer experience for your API
Api
⭐
103
Structured LLM APIs
Opentau
⭐
85
Using Large Language Models for Gradual Type Inference
Smolrsrwkv
⭐
82
A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
Tenere
⭐
74
🔥 TUI interface for LLMs written in Rust
Bott
⭐
71
bott: Your Terminal Copilot
Signway
⭐
70
Bring the power of pre-signed URLs to your apps. Signway is a gateway for redirecting ephimeral signed URLs to the requested API
Baml
⭐
66
A programming language to build strongly-typed LLM functions. Testing and observability included
Smartcat
⭐
48
Putting a brain behind `cat`🐈⬛ Integrating language models in the Unix commands ecosystem through text streams.
Llm Rs Python
⭐
44
Unofficial python bindings for the rust llm library. 🐍❤️🦀
Orphic
⭐
37
A natural language shell interface for *nix systems
Mixtral
⭐
36
Inference Mixtral 8x7B in pure Rust
Chitchat
⭐
35
A simple LLM chat front-end that makes it easy to find, download, and mess around with models on your local machine.
Openai_trtllm
⭐
34
OpenAI compatible API for TensorRT LLM triton backend
Hoof
⭐
32
"Just hoof it!" - A spotlight like interface to Ollama
Memex
⭐
29
Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
Watercooler
⭐
24
WaterCooler is an open source, desktop GUI for interacting with ChatGPT, created with Tauri.
Awesome Rust List
⭐
22
A collection of some awesome public Rust programming language projects.
Langchain_rs
⭐
21
Rust version of LangChain
Epistemology
⭐
21
A simple and clear way of hosting llama.cpp as a private HTTP API using Rust
Auto Rust
⭐
19
auto-rust is an experimental project that aims to automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.
Ai Companion
⭐
15
Backend, API and WebUI that makes you able to easily create your own custom AI chatbot/character locally
Chatty Llama
⭐
13
A fullstack Rust + React chat app using open-source Llama language models
Ollama Grid Search
⭐
12
A Rust based tool to evaluate LLM models and model params, when using Ollama for inference.
Acm
⭐
11
A dead-simple AI-powered CLI tool for effortlessly crafting meaningful Git commit messages
Edge Infer
⭐
10
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型(包括向量化和 Onnx 模型),如 Android、iOS 或 MCUs,实现高效的边缘智能,用于实时决策。
Collective
⭐
10
Automate non-novel work
Awesome Rust Llm
⭐
9
🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI
Shortgpt
⭐
6
Ask shortgpt for instant and concise answers
Txtask
⭐
5
Ask Ollama about your local text files
Llm_client
⭐
5
Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.
Pana
⭐
5
A locally hosted desktop assistant.
Related Searches
Command Line Rust (3,187)
Rust R (1,912)
Javascript Rust (1,421)
Python Llm (1,377)
Video Game Rust (1,177)
Rust Bindings (1,155)
Typescript Rust (1,111)
Rust Language (1,068)
Python Rust (966)
Rust Blockchain (938)
1-55 of 55 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.