Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for mlops model serving
mlops
x
model-serving
x
23 search results found
Vllm
⭐
13,832
A high-throughput and memory-efficient inference and serving engine for LLMs
Bentoml
⭐
6,575
The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Fedml
⭐
3,946
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://nexus.fedml.ai) is the dedicated cloud service for generative AI
Kserve
⭐
3,239
Standardized Serverless ML Inference Platform on Kubernetes
Envd
⭐
1,869
🏕️ Reproducible development environment
Mlrun
⭐
1,177
Machine Learning automation and tracking
Hopsworks
⭐
1,041
Hopsworks - Data-Intensive AI platform with a Feature Store
Yatai
⭐
748
Model Deployment at Scale on Kubernetes 🦄️
Mosec
⭐
661
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
Chitra
⭐
219
A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.
Clearml Serving
⭐
115
ClearML - Model-Serving Orchestration and Repository Solution
Nbox
⭐
84
The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸
Monai Deploy App Sdk
⭐
74
MONAI Deploy App SDK offers a framework and associated tools to design, develop and verify AI-driven applications in the healthcare imaging domain.
Serving Pytorch Models
⭐
43
Serving PyTorch models with TorchServe 🔥
Serving Tensorflow Models
⭐
37
Serving TensorFlow models with TensorFlow Serving 📙
Stackn
⭐
36
A minimalistic and pluggable machine learning platform for Kubernetes.
Clip Api Service
⭐
27
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
Transformers Nlp Service
⭐
26
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
Sdk Python
⭐
23
Python library for Modzy Machine Learning Operations (MLOps) Platform
Kedro Mlflow Tutorial
⭐
21
A tutorial on how to use kedro-mlflow plugin (https://github.com/Galileo-Galilei/kedro-mlflow) to synchronize training and inference and serve kedro pipeline
Inferencedb
⭐
20
🚀 Stream inferences of real-time ML models in production to any data lake
Kedro Serving
⭐
13
A kedro-plugin to serve Kedro Pipelines as API
Ray_vllm_inference
⭐
5
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
1-23 of 23 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.