Awesome Open Source

Programming Languages

Search results for llmops llm inference

llm-inference x

15 search results found

Autogen ⭐ 20,880

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ

Openllm ⭐ 7,871

Operating LLMs in production

Superduperdb ⭐ 3,924

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

Llm Action ⭐ 2,955

本项目旨在分享大模型相关技术原理以及实战经验。

Ray Llm ⭐ 972

RayLLM - LLMs on Ray

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Llmflows ⭐ 565

LLMFlows - Simple, Explicit and Transparent LLM Apps

LLMs and Machine Learning done easily

Runbooks ⭐ 151

Finetune LLMs on K8s by using Runbooks

Llmtuner ⭐ 137

Tune LLM in few lines of code

Multi-Agent Conversation Framework in TypeScript

Friendli Client ⭐ 23

Friendli: the fastest serving engine for generative AI such as LLMs

Arcee Python ⭐ 12

The Arcee client for executing domain-adpated language model routines

Llm Inference Solutions ⭐ 12

A collection of all available inference solutions for the LLMs

Awesome Llm Productization ⭐ 6

Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization

Related Searches

Python Llm Inference (53)

Llm Llmops (50)

Python Llmops (43)

1-15 of 15 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.