Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 13 Pipeline Parallelism Open Source Projects

Open source projects categorized as Pipeline Parallelism
Categories > Pipeline Parallelism
Colossalai ⭐ 37,814
Making large AI models cheaper, faster and more accessible
most recent commit a month ago
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79most recent commit a month agopypi deepspeed} Downloads
Petals ⭐ 8,040
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
dependent packages 1total releases 18most recent commit 5 months agopypi petals} Downloads
Torchgpipe ⭐ 479
A GPipe implementation in PyTorch
dependent packages 2total releases 9most recent commit 4 years agopypi torchgpipe} Downloads
Paddlefleetx ⭐ 421
飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
total releases 9most recent commit 2 months ago
Libai ⭐ 371
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
most recent commit 4 months ago
Easyparallellibrary ⭐ 201
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
most recent commit a year ago
Awesome Distributed Ml ⭐ 124
A curated list of awesome projects and papers for distributed training or inference
most recent commit 5 months ago
Torchpipe ⭐ 91
Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends
most recent commit 4 months ago
Pipegoose ⭐ 58
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
most recent commit 5 months ago
Ftpipe ⭐ 37
FTPipe and related pipeline model parallelism research.
most recent commit a year ago
Chimera ⭐ 29
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.
most recent commit 6 months ago
Pytorch Gpt X ⭐ 14
Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
most recent commit 2 years ago
The 3 Most Depended On Pipeline Parallelism Open Source Projects
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit a month agopypi deepspeed} Downloads
Torchgpipe ⭐ 479
A GPipe implementation in PyTorch
dependent packages 2total releases 9latest release September 18, 2020most recent commit 4 years agopypi torchgpipe} Downloads
Petals ⭐ 8,040
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
dependent packages 1total releases 18latest release November 20, 2023most recent commit 5 months agopypi petals} Downloads
The 4 Latest Releases In Pipeline Parallelism Open Source Projects
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit a month agopypi deepspeed} Downloads
Petals ⭐ 8,040
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
dependent packages 1total releases 18latest release November 20, 2023most recent commit 5 months agopypi petals} Downloads
Torchgpipe ⭐ 479
A GPipe implementation in PyTorch
dependent packages 2total releases 9latest release September 18, 2020most recent commit 4 years agopypi torchgpipe} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.