Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Ray | 28,892 | 80 | 362 | an hour ago | 94 | December 01, 2023 | 3,474 | apache-2.0 | Python | |
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. | ||||||||||
Gradio | 24,374 | 1 | 227 | 19 hours ago | 533 | November 23, 2023 | 470 | apache-2.0 | Python | |
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work! | ||||||||||
Bentoml | 5,944 | 12 | 5 hours ago | 119 | November 20, 2023 | 177 | apache-2.0 | Python | ||
Build Production-Grade AI Applications | ||||||||||
Fate | 5,311 | 1 | 2 hours ago | 33 | September 20, 2023 | 811 | apache-2.0 | Python | ||
An Industrial Grade Federated Learning Framework | ||||||||||
Seldon Core | 4,009 | 13 | 7 | 6 days ago | 48 | August 17, 2023 | 113 | apache-2.0 | HTML | |
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models | ||||||||||
Production Level Deep Learning | 3,957 | 17 days ago | 7 | |||||||
A guideline for building practical production-level deep learning systems to be deployed in real world applications. | ||||||||||
Orchest | 3,876 | 6 months ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
Build data pipelines, the easy way 🛠️ | ||||||||||
Opyrator | 2,964 | 6 days ago | 11 | May 04, 2021 | 5 | mit | Python | |||
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more. | ||||||||||
Transformer Deploy | 1,542 | a month ago | 53 | apache-2.0 | Python | |||||
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀 | ||||||||||
Seldon Server | 1,420 | 4 years ago | 44 | June 28, 2017 | 26 | apache-2.0 | Java | |||
Machine Learning Platform and Recommendation Engine built on Kubernetes |
🇨🇳 Translation in Chinese
🏷 Note: This repo is under continous development, and all feedback and contribution are very welcome 😊
Deploying deep learning models in production can be challenging, as it is far beyond training models with good performance. Several distinct components need to be designed and developed in order to deploy a production level deep learning system (seen below):
This repo aims to be an engineering guideline for building production-level deep learning systems which will be deployed in real world applications.
The material presented here is borrowed from Full Stack Deep Learning Bootcamp (by Pieter Abbeel at UC Berkeley, Josh Tobin at OpenAI, and Sergey Karayev at Turnitin), TFX workshop by Robert Crowe, and Pipeline.ai's Advanced KubeFlow Meetup by Chris Fregly.
Fun 😳 fact: 85% of AI projects fail. 1 Potential reasons include:
The two important factors to consider when defining and prioritizing ML projects:
The following figure represents a high level overview of different components in a production level deep learning system:
Approaches:
Platforms:
Machine Learning production software requires a more diverse set of test suites than traditional software:
[TBD]
[TBD]
[1]: Full Stack Deep Learning Bootcamp, Nov 2019.
[2]: Advanced KubeFlow Workshop by Pipeline.ai, 2019.