Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Distributed Computing Open Source Projects

Open source projects categorized as Python Distributed Computing
Categories > Software Architecture > Distributed Computing
Colossalai ⭐ 25,613
Making large AI models cheaper, faster and more accessible
most recent commit an hour ago
Catalyst ⭐ 3,103
Accelerated deep learning R&D
dependent packages 10total releases 108most recent commit 2 days agopypi catalyst} Downloads
Nakedtensor ⭐ 2,471
Bare bone examples of machine learning in TensorFlow
most recent commit 6 years ago
Alpa ⭐ 2,178
Training and serving large-scale neural networks
total releases 7most recent commit 15 hours ago
Elephas ⭐ 1,548
Distributed Deep learning with Keras & Spark
total releases 23most recent commit 6 months ago
Fugue ⭐ 1,465
A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark, Dask and Ray without any rewrites.
dependent packages 9total releases 83most recent commit a day agopypi fugue} Downloads
Distributed ⭐ 1,452
A distributed task scheduler for Dask
dependent packages 298total releases 178most recent commit 8 hours agopypi distributed} Downloads
Sparkit Learn ⭐ 1,054
PySpark + Scikit-learn = Sparkit-learn
total releases 13most recent commit 2 years ago
Vizier ⭐ 1,001
Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
total releases 5most recent commit 17 hours ago
Federated Learning Pytorch ⭐ 902
Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data
most recent commit 8 days ago
Fiber ⭐ 864
Distributed Computing for AI Made Simple
total releases 6most recent commit 2 years ago
Bagua ⭐ 818
Bagua Speeds up PyTorch
total releases 425most recent commit 5 days ago
Couler ⭐ 791
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
most recent commit a month ago
Rain ⭐ 713
Framework for large distributed pipelines
dependent packages 2total releases 8most recent commit 2 months agocargo rain_core} Downloads
Daft ⭐ 515
The Python DataFrame for Complex Data
most recent commit 7 hours ago
Atm ⭐ 481
Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).
total releases 14most recent commit 3 years ago
Openfl ⭐ 475
An open framework for Federated Learning.
most recent commit a day ago
Pfl Non Iid ⭐ 454
Personalized federated learning simulation platform with non-IID and unbalanced dataset
most recent commit 11 hours ago
Ai Horde ⭐ 428
A crowdsourced distributed cluster for AI art and text generation
most recent commit 5 days ago
Backend.ai ⭐ 365
Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, TPU, IPU and other NPUs.
dependent packages 8total releases 11most recent commit 5 hours agopypi backend.ai-plugin} Downloads
Tdigest ⭐ 332
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
dependent packages 12total releases 14most recent commit 6 months agopypi tdigest} Downloads
Machinaris ⭐ 329
An easy-to-use WebUI for crypto plotting and farming. Offers Bladebit, Gigahorse, MadMax, Chiadog and Plotman in a Docker container. Supports Chia, MMX, Chives, Flax, HDDCoin, and BPX among others.
most recent commit 6 days ago
Python Seminar ⭐ 310
Python for Data Science (Seminar Course at UC Berkeley; AY 250)
most recent commit a year ago
The 10 Most Depended On Python Distributed Computing Open Source Projects
Distributed ⭐ 1,452
A distributed task scheduler for Dask
dependent packages 298total releases 178latest release June 24, 2022most recent commit 8 hours agopypi distributed} Downloads
Tdigest ⭐ 332
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
dependent packages 12total releases 14latest release May 07, 2019most recent commit 6 months agopypi tdigest} Downloads
Catalyst ⭐ 3,103
Accelerated deep learning R&D
dependent packages 10total releases 108latest release April 29, 2022most recent commit 2 days agopypi catalyst} Downloads
Dirac ⭐ 104
DIRAC Grid
dependent packages 7total releases 131latest release July 07, 2022most recent commit 2 days agopypi DIRAC} Downloads
Selinon ⭐ 277
An advanced distributed task flow management on top of Celery
dependent packages 5total releases 18latest release March 31, 2022most recent commit 2 months agopypi selinon} Downloads
Qcfractal ⭐ 117
A distributed compute and database platform for quantum chemistry.
dependent packages 2total releases 14latest release February 10, 2022most recent commit 4 months ago
Rain ⭐ 713
Framework for large distributed pipelines
dependent packages 2total releases 8latest release September 05, 2018most recent commit 2 months agocargo rain_core} Downloads
Dask Saturn ⭐ 12
Python library for interacting with Dask clusters in Saturn
dependent packages 2total releases 17latest release November 04, 2021most recent commit 6 months agopypi dask-saturn} Downloads
The 10 Latest Releases In Python Distributed Computing Open Source Projects
Dirac ⭐ 104
DIRAC Grid
dependent packages 7total releases 131latest release July 07, 2022most recent commit 2 days agopypi DIRAC} Downloads
Alpa ⭐ 2,178
Training and serving large-scale neural networks
total releases 7latest release July 04, 2022most recent commit 15 hours ago
Distributed ⭐ 1,452
A distributed task scheduler for Dask
dependent packages 298total releases 178latest release June 24, 2022most recent commit 8 hours agopypi distributed} Downloads
Angorapy ⭐ 11
Anthropomorphic goal-driven deep learning toolbox for neuroscientists.
total releases 3latest release June 12, 2022most recent commit 7 days ago
Ganga ⭐ 85
Ganga is an easy-to-use frontend for job definition and management
total releases 89latest release June 06, 2022most recent commit 3 days ago
Cubed ⭐ 46
Bounded-memory serverless distributed N-dimensional array processing
total releases 5latest release May 22, 2022most recent commit 5 days ago
Catalyst ⭐ 3,103
Accelerated deep learning R&D
dependent packages 10total releases 108latest release April 29, 2022most recent commit 2 days agopypi catalyst} Downloads
Popular Software Architecture Categories
Mvc
Dependency Injection
Mvvm
Mvp
Design Pattern
Flux
Domain Driven Design
Viewmodel
Cqrs
Distributed Systems
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.