Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pytorch Distributed Training Open Source Projects

Open source projects categorized as Pytorch Distributed Training
Categories > Distributed Training
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5most recent commit 4 months ago
Pytorch Image Models ⭐ 29,680
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
dependent packages 346total releases 55most recent commit 8 days agopypi timm} Downloads
Fengshenbang Lm ⭐ 3,670
Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型
most recent commit 4 months ago
Byteps ⭐ 3,254
A high performance and generic framework for distributed DNN training
total releases 8most recent commit 2 years ago
Determined ⭐ 2,715
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
dependent packages 1total releases 221most recent commit 3 months ago
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27most recent commit 4 months agopypi hivemind} Downloads
Efficient Dl Systems ⭐ 502
Efficient Deep Learning Systems course materials (HSE, YSDA)
most recent commit 3 months ago
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12most recent commit a year agopypi adaptdl} Downloads
Handyrl ⭐ 278
HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.
most recent commit 3 months ago
Torchx ⭐ 275
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
dependent packages 4total releases 728most recent commit 3 months agopypi torchx-nightly} Downloads
Pytorch Sync Batchnorm Example ⭐ 134
How to use Cross Replica / Synchronized Batchnorm in Pytorch
most recent commit 5 years ago
Saturn ⭐ 86
Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.
most recent commit 5 months ago
Integrated Design Diffusion Model ⭐ 50
IDDM (Industrial, landscape, animate...), support DDPM, DDIM, webui and multi-GPU distributed training. Pytorch实现，生成模型，扩散模型，分布式训练
most recent commit 3 months ago
Note ⭐ 31
Easily implement parallel training and distributed training. Machine learning library.
most recent commit 3 months ago
Pytorch Model Parallel ⭐ 29
A memory balanced and communication efficient FullyConnected layer with CrossEntropyLoss model parallel implementation in PyTorch
most recent commit 4 years ago
Realtime Semantic Segmentation Pytorch ⭐ 22
PyTorch implementation of over 30 realtime semantic segmentations models, e.g. BiSeNetv1, BiSeNetv2, CGNet, ContextNet, DABNet, DDRNet, EDANet, ENet, ERFNet, ESPNet, ESPNetv2, FastSCNN, ICNet, LEDNet, LinkNet, PP-LiteSeg, SegNet, ShelfNet, STDC, SwiftNet, and support knowledge distillation, distributed training etc.
most recent commit 3 months ago
Distributed Pytorch ⭐ 22
Distributed, mixed-precision training with PyTorch
most recent commit 4 years ago
Horovod Ansible ⭐ 21
Create Horovod cluster easily using Ansible
most recent commit 5 years ago
Pytorch Distributed Nlp ⭐ 20
pytorch分布式训练
most recent commit 9 months ago
Shockwave ⭐ 14
Code for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
most recent commit a year ago
Large Scale Pretraining Transfer ⭐ 11
Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)
most recent commit 2 years ago
Pytorch Multi Gpu Training Tutorial ⭐ 10
most recent commit 2 years ago
A Pytorch Tutorial To Class Incremental Learning ⭐ 10
a PyTorch Tutorial to Class-Incremental Learning | a Distributed Training Template of CIL with core code less than 100 lines.
most recent commit 2 years ago
The 5 Most Depended On Pytorch Distributed Training Open Source Projects
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 4 months agopypi hivemind} Downloads
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12latest release April 20, 2022most recent commit a year agopypi adaptdl} Downloads
The 7 Latest Releases In Pytorch Distributed Training Open Source Projects
Hivemind ⭐ 1,716
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
dependent packages 6total releases 27latest release August 31, 2023most recent commit 4 months agopypi hivemind} Downloads
Adaptdl ⭐ 339
Resource-adaptive cluster scheduler for deep learning training.
dependent packages 3total releases 12latest release April 20, 2022most recent commit a year agopypi adaptdl} Downloads
Byteps ⭐ 3,254
A high performance and generic framework for distributed DNN training
total releases 8latest release August 02, 2021most recent commit 2 years ago
Made With Ml ⭐ 35,496
Learn how to design, develop, deploy and iterate on production-grade ML applications.
total releases 5latest release May 15, 2019most recent commit 4 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.