Awesome Open Source

Programming Languages

Search results for llmops

119 search results found

Autogen ⭐ 20,880

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

Superagi ⭐ 13,542

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Openllm ⭐ 7,871

Operating LLMs in production

Bentoml ⭐ 6,575

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

Litellm ⭐ 4,837

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Superduperdb ⭐ 3,924

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

Zenml ⭐ 3,626

ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.

Gateway ⭐ 3,199

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Llm Action ⭐ 2,955

本项目旨在分享大模型相关技术原理以及实战经验。

Ragas ⭐ 2,582

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Giskard ⭐ 2,509

🐢 The testing framework for ML models, from tabular to LLMs

Awesome Llmops ⭐ 2,417

An awesome & curated list of best LLMOps tools for developers

Agixt ⭐ 2,267

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Openpipe ⭐ 2,190

Turn expensive prompts into cheap fine-tuned models

Phoenix ⭐ 1,983

AI Observability & Evaluation - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook.

Langfuse ⭐ 1,901

🪢 Open source LLM observability, analytics, prompt management, evaluations, tests, monitoring, logging, tracing, LLMOps. 🕵️‍♂️ Langfuse: the LLM engineering platform. Debug, analyze and iterate together - 🍊YC W23 🤖 Stable SDKs + integrations for Typescript, Python, OpenAI, Langchain, Litellm, Flowise, Superagent and Langflow

Nextpy ⭐ 1,893

⚡Pure Python App Framework: For Humans & LLMs🤖 World's first AMS🥇

🏕️ Reproducible development environment

Promptfoo ⭐ 1,785

Test your prompts, models, RAGs. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. LLM evals for OpenAI/Azure GPT, Anthropic Claude, VertexAI Gemini, Ollama, Local & private models like Mistral/Mixtral/Llama with CI/CD

Uptrain ⭐ 1,713

Your open-source LLM evaluation toolkit. Get scores for factual accuracy, context retrieval quality, tonality, and many more to understand the quality of your LLM applications

Cube Studio ⭐ 1,710

cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，数据资产对

Llm App ⭐ 1,573

LLM App is a production framework for building and serving AI applications and LLM-enabled real-time data pipelines.

Pezzo ⭐ 1,500

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Chainforge ⭐ 1,440

An open-source visual programming environment for battle-testing prompts to LLMs.

Hands On Llms ⭐ 1,393

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

Hamilton ⭐ 1,388

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

Chidori ⭐ 1,131

A reactive runtime for building durable AI agents

Trulens ⭐ 1,109

Evaluation and Tracking for LLM Experiments

Bionic Gpt ⭐ 1,008

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality

Ray Llm ⭐ 972

RayLLM - LLMs on Ray

The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.

Lanarky ⭐ 903

The web framework for building LLM microservices

Llmstack ⭐ 853

No-code platform to build LLM Agents, workflows and applications with your data

Motorhead ⭐ 787

🧠 Motorhead is a memory and information retrieval server for LLMs.

LLM Prompt Injection Detector

Llm.report ⭐ 739

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

Langcorn ⭐ 729

⛓️ Serving LangChain LLM apps automagically with FastApi. LLMops

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Openllmetry ⭐ 664

Open-source observability for your LLM application, based on OpenTelemetry

Llm Guard ⭐ 567

The Security Toolkit for LLM Interactions

Llmflows ⭐ 565

LLMFlows - Simple, Explicit and Transparent LLM Apps

Prem App ⭐ 431

Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure

LLMs and Machine Learning done easily

Awesome Ai Sdks ⭐ 412

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

A fast and minimal framework for building agent-integrated systems

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

Phidata ⭐ 220

Build AI Assistants using function calling

Llm Python ⭐ 218

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

Self-hardening firewall for large language models

Infino - Next-gen OpenSearch Observability. Faster, Cheaper, Smarter.

Openmodelz ⭐ 182

One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

Starwhale ⭐ 178

an MLOps/LLMOps platform

Rtp Llm ⭐ 157

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Runbooks ⭐ 151

Finetune LLMs on K8s by using Runbooks

Gptrouter ⭐ 148

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Llmtuner ⭐ 137

Tune LLM in few lines of code

Vigil Llm ⭐ 132

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

Tonic_validate ⭐ 128

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Athina Sdk ⭐ 127

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

Spelltest ⭐ 105

AI-to-AI Testing | Simulation framework for LLM-based applications

Trubrics Sdk ⭐ 104

The first user analytics platform for AI models

Vectorhub ⭐ 95

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

Promethai Backend ⭐ 86

Open-source framework that gives you AI Agents that help you navigate decision-making, get personalized goals and execute them

Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.

Promptdesk ⭐ 81

Promptdesk is a tool designed for effectively creating, organizing, and evaluating prompts and large language models (LLMs).

Continuous Eval ⭐ 78

Evaluation for LLM / RAG pipelines, ready for CI/CD

Genai Stack ⭐ 77

An End to End GenAI Framework

A programming language to build strongly-typed LLM functions. Testing and observability included

Llmops Promptflow Template ⭐ 65

LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

Awesome Ai Safety ⭐ 64

A curated list of papers & technical articles on AI Quality & Safety 📚

Codergpt ⭐ 54

Code context-aware pre-prompt rules for using GPT-4 as a coding assistant effectively.

Python client library for managing your LLM data in one place

Superknowa ⭐ 53

Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging componants like Lego pieces. This repo is intended for IBM Ecosystem partners.

Athina Evals ⭐ 45

Python SDK for running evaluations on LLM generated responses

Multi-Agent Conversation Framework in TypeScript

Sugarcane Ai ⭐ 39

npm like package ecosystem for Prompts 🤖

Ml_observability_course ⭐ 38

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

Python client for Kolena's machine learning testing platform

Llm Api Starterkit ⭐ 33

Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

Openinference ⭐ 29

OpenInference instrumentation for AI Observability

Transformers Nlp Service ⭐ 26

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

A tool to provision MLOps environments in Azure

Openllmetry Js ⭐ 24

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Friendli Client ⭐ 23

Friendli: the fastest serving engine for generative AI such as LLMs

Join the movement led by IZX.ai to create the world's best open-source LLM.

Llm Books ⭐ 19

利用LLM构建应用实践笔记

A diverse, simple, and secure one-stop LLMOps platform

Awesome Llmops ⭐ 18

Awesome series for LLMOps

Llm Resource ⭐ 18

LLM全栈优质资源汇总

🐦 A Lightweight, Cloud-Native LLM Gateway

AI book for everyone

⚡️ Transform AI/ML operations: Transparency, Control and Cost Optimization. ⚡️

Pointstorm ⭐ 15

Real-time embeddings for data on the move

Starcloud Llmops ⭐ 15

starcloud-llmops java back-end program

Sugarcane Ai.github.io ⭐ 13

Parea Sdk Py ⭐ 13

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

Geniusrise ⭐ 13

Geniusrise: Framework for building geniuses

1-100 of 119 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.