Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Distributed Training Open Source Projects

Open source projects categorized as Distributed Training
Categories > Distributed Training
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5most recent commit 5 months ago
Pytorch Image Models ⭐ 29,680
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
dependent packages 346total releases 55most recent commit 14 days agopypi timm} Downloads
Paddle ⭐ 21,527
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
total releases 79most recent commit a month ago
Paddlenlp ⭐ 10,908
👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
dependent packages 19total releases 87most recent commit 3 months agopypi paddlenlp} Downloads
Skypilot ⭐ 4,975
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
dependent packages 4total releases 32most recent commit 3 months agopypi skypilot} Downloads
Fedml ⭐ 3,946
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, FEDML Nexus AI (https://nexus.fedml.ai) is the dedicated cloud service for generative AI
dependent packages 1total releases 342most recent commit 3 months agopypi fedml} Downloads
Fengshenbang Lm ⭐ 3,670
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型
most recent commit 4 months ago
Adanet ⭐ 3,309
Fast and flexible AutoML with learning guarantees.
dependent packages 1total releases 13most recent commit 3 years agopypi adanet} Downloads
Byteps ⭐ 3,254
A high performance and generic framework for distributed DNN training
total releases 8most recent commit 2 years ago
Alpa ⭐ 2,878
Training and serving large-scale neural networks with auto parallelization.
total releases 13most recent commit 5 months ago
Determined ⭐ 2,715
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
dependent packages 1total releases 221most recent commit 3 months ago
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27most recent commit 5 months agopypi hivemind} Downloads
Hyperpose ⭐ 1,237
Library for Fast and Flexible Human Pose Estimation
total releases 3most recent commit a year ago
Deeprec ⭐ 922
DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.
most recent commit 3 months ago
Efficient Dl Systems ⭐ 502
Efficient Deep Learning Systems course materials (HSE, YSDA)
most recent commit 3 months ago
Libai ⭐ 371
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
most recent commit 3 months ago
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12most recent commit a year agopypi adaptdl} Downloads
Relora ⭐ 337
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
most recent commit 4 months ago
Hypergbm ⭐ 306
A full pipeline AutoML tool for tabular data
dependent packages 1total releases 17most recent commit 4 months agopypi hypergbm} Downloads
Handyrl ⭐ 278
HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.
most recent commit 3 months ago
Torchx ⭐ 275
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
dependent packages 4total releases 728most recent commit 3 months agopypi torchx-nightly} Downloads
Kungfu ⭐ 266
Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.
total releases 13most recent commit a year ago
Deeplearning Cfn ⭐ 244
Distributed Deep Learning on AWS Using CloudFormation (CFN), MXNet and TensorFlow
most recent commit 4 years ago
The 10 Most Depended On Distributed Training Open Source Projects
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 5 months agopypi hivemind} Downloads
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12latest release April 20, 2022most recent commit a year agopypi adaptdl} Downloads
Pinpoint Node Agent ⭐ 51
Pinpoint Node.js agent
dependent packages 2total releases 23latest release July 07, 2023most recent commit 3 months agonpm pinpoint-node-agent} Downloads
Adanet ⭐ 3,309
Fast and flexible AutoML with learning guarantees.
dependent packages 1total releases 13latest release July 09, 2020most recent commit 3 years agopypi adanet} Downloads
Hypergbm ⭐ 306
A full pipeline AutoML tool for tabular data
dependent packages 1total releases 17latest release May 31, 2022most recent commit 4 months agopypi hypergbm} Downloads
The 10 Latest Releases In Distributed Training Open Source Projects
Redco ⭐ 35
MLSys Workshop NeurIPS 2023 - Redco: A Lightweight Tool to Automate Distributed Training and Inference
total releases 11latest release November 08, 2023most recent commit 4 months ago
Pytorch Base Trainer ⭐ 46
Pytorch分布式训练框架
total releases 16latest release September 19, 2023most recent commit 4 months ago
Gradientaccumulator ⭐ 47
:dart: Accumulated Gradients for TensorFlow 2
total releases 15latest release September 08, 2023most recent commit 3 months ago
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 5 months agopypi hivemind} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.