Awesome Open Source

Programming Languages

Search results for nccl

11 search results found

NumPy & SciPy for GPU

Bluefog ⭐ 282

Distributed and decentralized training framework for PyTorch over graph

Large_language_model_training_playbook ⭐ 235

An open collection of implementation tips, tricks and resources for training large language models

Llm_training_handbook ⭐ 235

An open collection of methodologies to help with successful training of large language models.

Msrflute ⭐ 164

Federated Learning Utilities and Tools for Experimentation

Tutorial Multi Gpu ⭐ 116

Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial

Nccl Fastsocket ⭐ 88

NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.

Python Distributed Non Negative Matrix Factorization with custom clustering

Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, allGather, reduceScatter and sendRecv operations.

Bagua Net ⭐ 9

High performance NCCL plugin for Bagua.

Nccl Examples ⭐ 6

NCCL Examples from Official NVIDIA NCCL Developer Guide.

Related Searches

Python Nccl (4)

Pytorch Nccl (3)

Nvidia Nccl (3)

1-11 of 11 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.