Awesome Open Source

Programming Languages

Search results for python model parallelism

model-parallelism x

7 search results found

Torchgpipe ⭐ 479

A GPipe implementation in PyTorch

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Easyparallellibrary ⭐ 201

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.

Pipegoose ⭐ 58

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

MLSys Workshop NeurIPS 2023 - Redco: A Lightweight Tool to Automate Distributed Training and Inference

An instant distributed computing library based on Ray Train and Ray Data

Pytorch Transformer Distributed ⭐ 5

Distributed training (multi-node) of a Transformer model

Related Searches

Python Machine Learning (19,284)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

Python Pytorch (7,877)

Python Natural Language Processing (5,233)

Python Pipeline (4,391)

Python Tutorials (3,702)

Python Neural Network (3,491)

1-7 of 7 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.