Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for mlops llmops
llmops
x
mlops
x
45 search results found
Jina
⭐
19,573
☁️ Build multimodal AI applications with cloud-native stack
Vllm
⭐
13,832
A high-throughput and memory-efficient inference and serving engine for LLMs
Openllm
⭐
7,871
Operating LLMs in production
Bentoml
⭐
6,575
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Superduperdb
⭐
3,924
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Zenml
⭐
3,626
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
Giskard
⭐
2,509
🐢 The testing framework for ML models, from tabular to LLMs
Awesome Llmops
⭐
2,417
An awesome & curated list of best LLMOps tools for developers
Phoenix
⭐
1,983
AI Observability & Evaluation - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook.
Nextpy
⭐
1,893
⚡Pure Python App Framework: For Humans & LLMs🤖 World's first AMS🥇
Envd
⭐
1,869
🏕️ Reproducible development environment
Cube Studio
⭐
1,710
cube studio开源云原生一站式机器学习/深度学习AI平台,支持sso登录,多租户/多项目组,数据资产对
Hands On Llms
⭐
1,393
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Hamilton
⭐
1,388
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Motorhead
⭐
787
🧠 Motorhead is a memory and information retrieval server for LLMs.
Llm.report
⭐
739
📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.
Neumai
⭐
693
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
Prem App
⭐
431
Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure
Sagify
⭐
422
LLMs and Machine Learning done easily
Openmodelz
⭐
182
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
Starwhale
⭐
178
an MLOps/LLMOps platform
Runbooks
⭐
151
Finetune LLMs on K8s by using Runbooks
Gptrouter
⭐
148
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
Athina Sdk
⭐
127
LLM Testing SDK that helps you write and run tests to monitor your LLM app in production
Trubrics Sdk
⭐
104
The first user analytics platform for AI models
Vectorhub
⭐
95
VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.
Saturn
⭐
86
Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.
Genai Stack
⭐
77
An End to End GenAI Framework
Llmops Promptflow Template
⭐
65
LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.
Awesome Ai Safety
⭐
64
A curated list of papers & technical articles on AI Quality & Safety 📚
Ml_observability_course
⭐
38
Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.
Kolena
⭐
37
Python client for Kolena's machine learning testing platform
Transformers Nlp Service
⭐
26
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
Matcha
⭐
25
A tool to provision MLOps environments in Azure
Friendli Client
⭐
23
Friendli: the fastest serving engine for generative AI such as LLMs
Awesome Llmops
⭐
18
Awesome series for LLMOps
Ai_book
⭐
17
AI book for everyone
Glide
⭐
17
🐦 A Lightweight, Cloud-Native LLM Gateway
Geniusrise
⭐
13
Geniusrise: Framework for building geniuses
Llmtracer
⭐
10
Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
Logikon
⭐
9
Analyzing and scoring reasoning traces of LLMs
Bigbertha
⭐
7
BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kubernetes cluster using open source container-native technologies 🌟
Awesome Llm Productization
⭐
6
Awesome-LLM-Productization: a curated list of tools/tricks/news/regulations about AI and Large Language Model (LLM) productization
Ray_vllm_inference
⭐
5
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
Matcha Examples
⭐
5
Example workflows for matcha - a tool to provision environments in Azure
Related Searches
Machine Learning Mlops (408)
Python Mlops (345)
Jupyter Notebook Mlops (216)
Data Science Mlops (160)
Deep Learning Mlops (119)
Artificial Intelligence Mlops (107)
Pytorch Mlops (100)
1-45 of 45 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.