Awesome Open Source

Programming Languages

Search results for python llmops

65 search results found

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

Vllm ⭐ 13,832

A high-throughput and memory-efficient inference and serving engine for LLMs

Superagi ⭐ 13,542

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Openllm ⭐ 7,871

Operating LLMs in production

Litellm ⭐ 4,837

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Superduperdb ⭐ 3,924

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

Llm Action ⭐ 2,955

本项目旨在分享大模型相关技术原理以及实战经验。

Ragas ⭐ 2,582

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Giskard ⭐ 2,509

🐢 The testing framework for ML models, from tabular to LLMs

Agixt ⭐ 2,267

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Nextpy ⭐ 1,893

⚡Pure Python App Framework: For Humans & LLMs🤖 World's first AMS🥇

Uptrain ⭐ 1,713

Your open-source LLM evaluation toolkit. Get scores for factual accuracy, context retrieval quality, tonality, and many more to understand the quality of your LLM applications

Llm App ⭐ 1,573

LLM App is a production framework for building and serving AI applications and LLM-enabled real-time data pipelines.

Hamilton ⭐ 1,538

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

Pezzo ⭐ 1,500

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Ray Llm ⭐ 972

RayLLM - LLMs on Ray

Lanarky ⭐ 903

The web framework for building LLM microservices

Llmstack ⭐ 853

No-code platform to build LLM Agents, workflows and applications with your data

Langcorn ⭐ 729

⛓️ Serving LangChain LLM apps automagically with FastApi. LLMops

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Openllmetry ⭐ 664

Open-source observability for your LLM application, based on OpenTelemetry

Llm Guard ⭐ 567

The Security Toolkit for LLM Interactions

Llmflows ⭐ 565

LLMFlows - Simple, Explicit and Transparent LLM Apps

LLMs and Machine Learning done easily

A fast and minimal framework for building agent-integrated systems

Phidata ⭐ 220

Build AI Assistants using function calling

Llm Python ⭐ 218

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

Self-hardening firewall for large language models

Llmtuner ⭐ 137

Tune LLM in few lines of code

Vigil Llm ⭐ 132

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

Tonic_validate ⭐ 128

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Athina Sdk ⭐ 127

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

Spelltest ⭐ 105

AI-to-AI Testing | Simulation framework for LLM-based applications

Trubrics Sdk ⭐ 104

The first user analytics platform for AI models

Promethai Backend ⭐ 86

Open-source framework that gives you AI Agents that help you navigate decision-making, get personalized goals and execute them

Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.

Continuous Eval ⭐ 78

Evaluation for LLM / RAG pipelines, ready for CI/CD

Llmops Promptflow Template ⭐ 65

LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

Python client library for managing your LLM data in one place

Athina Evals ⭐ 45

Python SDK for running evaluations on LLM generated responses

Python client for Kolena's machine learning testing platform

Llm Api Starterkit ⭐ 33

Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

Openinference ⭐ 29

OpenInference instrumentation for AI Observability

Transformers Nlp Service ⭐ 26

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

A tool to provision MLOps environments in Azure

Friendli Client ⭐ 23

Friendli: the fastest serving engine for generative AI such as LLMs

Llm Books ⭐ 19

利用LLM构建应用实践笔记

Pointstorm ⭐ 15

Real-time embeddings for data on the move

Parea Sdk Py ⭐ 13

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

Geniusrise ⭐ 13

Geniusrise: Framework for building geniuses

Arcee Python ⭐ 12

The Arcee client for executing domain-adpated language model routines

Python Sdk ⭐ 12

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Llmtracer ⭐ 10

Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp

Mirascope ⭐ 9

The most pythonic LLM application building experience

Openserver ⭐ 9

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Analyzing and scoring reasoning traces of LLMs

Semi Agent ⭐ 7

A simple AI Agent Framework using table software like Excel/Google Sheets as GUI

Bigbertha ⭐ 7

BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kubernetes cluster using open source container-native technologies 🌟

Prompt Engineering and Dev-Ops toolkit for applications powered by Language Models

The Python package for phospho, the LLM analytics platform

Auditing with LLM evals for LLM applications.

Ray_vllm_inference ⭐ 5

A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.

Matcha Examples ⭐ 5

Example workflows for matcha - a tool to provision environments in Azure

Llm Prompt Testing ⭐ 5

Prompt Testing framework for LLMs (specifically OpenAI models). Compute NLP and Responsible AI metrics for each model-generated answer.

Related Searches

Python Machine Learning (20,195)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Testing (9,479)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Amazon Web Services (8,119)

Python Pytorch (7,877)

Python Neural (7,444)

1-65 of 65 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.