Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Distributed Training Open Source Projects

Open source projects categorized as Python Distributed Training
Categories > Distributed Training
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5most recent commit 5 months ago
Paddle ⭐ 21,527
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
total releases 79most recent commit a month ago
Paddlenlp ⭐ 10,908
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
dependent packages 19total releases 87most recent commit 3 months agopypi paddlenlp} Downloads
Skypilot ⭐ 4,975
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
dependent packages 4total releases 32most recent commit 3 months agopypi skypilot} Downloads
Fedml ⭐ 3,946
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://nexus.fedml.ai) is the dedicated cloud service for generative AI
dependent packages 1total releases 342most recent commit 3 months agopypi fedml} Downloads
Fengshenbang Lm ⭐ 3,670
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型
most recent commit 4 months ago
Adanet ⭐ 3,309
Fast and flexible AutoML with learning guarantees.
dependent packages 1total releases 13most recent commit 3 years agopypi adanet} Downloads
Byteps ⭐ 3,254
A high performance and generic framework for distributed DNN training
total releases 8most recent commit 2 years ago
Alpa ⭐ 2,878
Training and serving large-scale neural networks with auto parallelization.
total releases 13most recent commit 5 months ago
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27most recent commit 5 months agopypi hivemind} Downloads
Deeprec ⭐ 922
DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.
most recent commit 3 months ago
Libai ⭐ 371
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
most recent commit 3 months ago
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12most recent commit a year agopypi adaptdl} Downloads
Hypergbm ⭐ 306
A full pipeline AutoML tool for tabular data
dependent packages 1total releases 17most recent commit 4 months agopypi hypergbm} Downloads
Handyrl ⭐ 278
HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.
most recent commit 3 months ago
Torchx ⭐ 275
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
dependent packages 4total releases 728most recent commit 3 months agopypi torchx-nightly} Downloads
Deeplearning Cfn ⭐ 244
Distributed Deep Learning on AWS Using CloudFormation (CFN), MXNet and TensorFlow
most recent commit 4 years ago
Easyparallellibrary ⭐ 201
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
most recent commit a year ago
Terngrad ⭐ 152
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
most recent commit 5 years ago
Openks ⭐ 143
OpenKS - 领域可泛化的知识学习与计算引擎
most recent commit 10 months ago
Unicom ⭐ 142
universal visual model trained on LAION-400M
most recent commit 8 months ago
Plsc ⭐ 129
Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.
total releases 3most recent commit a year ago
Sagemaker Xgboost Container ⭐ 109
This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use their own XGBoost scripts in SageMaker.
most recent commit 4 months ago
The 8 Most Depended On Python Distributed Training Open Source Projects
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 5 months agopypi hivemind} Downloads
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12latest release April 20, 2022most recent commit a year agopypi adaptdl} Downloads
Adanet ⭐ 3,309
Fast and flexible AutoML with learning guarantees.
dependent packages 1total releases 13latest release July 09, 2020most recent commit 3 years agopypi adanet} Downloads
Hypergbm ⭐ 306
A full pipeline AutoML tool for tabular data
dependent packages 1total releases 17latest release May 31, 2022most recent commit 4 months agopypi hypergbm} Downloads
The 10 Latest Releases In Python Distributed Training Open Source Projects
Redco ⭐ 35
MLSys Workshop NeurIPS 2023 - Redco: A Lightweight Tool to Automate Distributed Training and Inference
total releases 11latest release November 08, 2023most recent commit 4 months ago
Pytorch Base Trainer ⭐ 46
Pytorch分布式训练框架
total releases 16latest release September 19, 2023most recent commit 4 months ago
Gradientaccumulator ⭐ 47
:dart: Accumulated Gradients for TensorFlow 2
total releases 15latest release September 08, 2023most recent commit 3 months ago
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 5 months agopypi hivemind} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.