Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 17 Data Parallelism Open Source Projects

Open source projects categorized as Data Parallelism
Categories > Data Parallelism
Colossalai ⭐ 37,814
Making large AI models cheaper, faster and more accessible
most recent commit 7 days ago
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79most recent commit 17 days agopypi deepspeed} Downloads
Dist Keras ⭐ 611
Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
total releases 2most recent commit 6 years ago
Weave ⭐ 500
A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead
most recent commit 5 months ago
Paddlefleetx ⭐ 421
飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
total releases 9most recent commit 22 days ago
Libai ⭐ 371
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
most recent commit 3 months ago
Easyparallellibrary ⭐ 201
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
most recent commit a year ago
Dkeras ⭐ 166
Distributed Keras Engine, Make Keras faster with only one line of code.
most recent commit 5 years ago
Terngrad ⭐ 152
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
most recent commit 5 years ago
Orkhon ⭐ 96
Orkhon: ML Inference Framework and Server Runtime
total releases 8most recent commit 3 years ago
Pipegoose ⭐ 58
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
most recent commit 4 months ago
Keras_multi_gpu ⭐ 38
Multi-GPU training for Keras
most recent commit 7 years ago
Enscale ⭐ 12
An instant distributed computing library based on Ray Train and Ray Data
total releases 10most recent commit 2 years ago
Sm Distributed Training Step By Step ⭐ 9
This repository provides hands-on labs on PyTorch-based Distributed Training and SageMaker Distributed Training. It is written to make it easy for beginners to get started, and guides you through step-by-step modifications to the code based on the most basic BERT use cases.
most recent commit 9 months ago
Effect Dps Public ⭐ 6
Understanding the effects of data parallelism and sparsity on neural network training
most recent commit 3 years ago
Parallel Matrix Multiplication Fox Algorithm ⭐ 5
☕Implement of Parallel Matrix Multiplication Methods Using FOX Algorithm on Peking University's High-performance Computing System
most recent commit 5 years ago
Pytorch Transformer Distributed ⭐ 5
Distributed training (multi-node) of a Transformer model
most recent commit 4 months ago
The 6 Latest Releases In Data Parallelism Open Source Projects
Deepspeed ⭐ 32,358
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
dependent packages 87total releases 79latest release December 01, 2023most recent commit 17 days agopypi deepspeed} Downloads
Enscale ⭐ 12
An instant distributed computing library based on Ray Train and Ray Data
total releases 10latest release March 22, 2022most recent commit 2 years ago
Orkhon ⭐ 96
Orkhon: ML Inference Framework and Server Runtime
total releases 8latest release February 01, 2021most recent commit 3 years ago
Dist Keras ⭐ 611
Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
total releases 2latest release October 26, 2017most recent commit 6 years ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.