Awesome Open Source

Programming Languages

Search results for machine learning distributed computing

distributed-computing x

machine-learning x

74 search results found

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Catalyst ⭐ 3,151

Accelerated deep learning R&D

Training and serving large-scale neural networks with auto parallelization.

Fugue ⭐ 1,821

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Awesome Federated Machine Learning ⭐ 1,425

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

Vizier ⭐ 1,142

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

Sparkit Learn ⭐ 1,054

PySpark + Scikit-learn = Sparkit-learn

Distributed DataFrame for Python designed for the cloud, powered by Rust

Distributed Computing for AI Made Simple

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Bagua Speeds up PyTorch

An open framework for Federated Learning.

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

Awesome Federated Computing ⭐ 448

📚 👓 A collection of research papers, codes, tutorials and blogs on Federated Computing/Learning.

Yggdrasil Decision Forests ⭐ 403

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

An experimental platform to quickly realize and compare with popular centralized federated learning algorithms. A realization of federated learning algorithm on fairness (FedFV, Federated Learning with Fair Averaging, https://fanxlxmu.github.io/publication/ijcai2021/) was accepted by IJCAI-21 (https://www.ijcai.org/proceedings/2021/223).

High performance distributed framework for training deep learning recommendation models based on PyTorch.

Paracel ⭐ 326

Distributed training framework with parameter server

Python Seminar ⭐ 310

Python for Data Science (Seminar Course at UC Berkeley; AY 250)

Awesome Distributed Deep Learning ⭐ 309

A curated list of awesome Distributed Deep Learning resources.

Bluefog ⭐ 282

Distributed and decentralized training framework for PyTorch over graph

Swarm Learning ⭐ 275

A simplified library for decentralized, privacy preserving machine learning

A Clojure dataframe library that runs on Spark

Cuneiform ⭐ 215

Cuneiform distributed programming language

Distributed DAG (Directed acyclic graph) framework for machine learning with UI

Ml Systems ⭐ 175

papers on scalable and efficient machine learning systems

A Comprehensive Framework for Building End-to-End Recommendation Systems with State-of-the-Art Models

Spark With Python ⭐ 98

Fundamentals of Spark with Python (using PySpark), code examples

Autodist ⭐ 92

Simple Distributed Deep Learning on TensorFlow

Learning_ray ⭐ 84

Code for the upcoming book "Learning Ray" with O'Reilly

Ensae_teaching_cs ⭐ 71

Teaching materials in python at the @ENSAE

Awesome Asynchronous Federated Learning ⭐ 68

📦 Collect some Asynchronous Federated Learning papers.

Mltoolkits ⭐ 65

learningOrchestra is a distributed Machine Learning integration tool that facilitates and streamlines iterative processes in a Data Science project.

Frovedis ⭐ 62

Framework of vectorized and distributed data analytics

Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.

Easydist ⭐ 55

Automated Parallelization System and Infrastructure for Multiple Ecosystems

Spacy Ray ⭐ 51

☄️ Parallel and distributed training with spaCy and Ray

Pythonframeworks ⭐ 49

Another curated list of Python frameworks

Secure distributed dataflow framework for encrypted machine learning and data processing

Lazycluster ⭐ 43

🎛 Distributed machine learning made simple.

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Archived Sansa Ml ⭐ 41

SANSA Machine Learning Layer

Ravenverse ⭐ 39

Decentralized Computing Backend for Artificial Intelligence, Web3, Metaverse, and Gaming Application

Lstm Tensorspark ⭐ 35

Implementation of a LSTM with TensorFlow and distributed on Apache Spark

Lipizzaner Gan ⭐ 30

[AAAI 2018] "Towards distributed coevolutionary GANs" by Abdullah Al-Dujaili, Tom Schmiedlechner, Erik Hemberg, Una-May O'Reilly

An abstraction layer for parameter tuning

Dpmmsubclusters.jl ⭐ 30

Distributed MCMC Inference in Dirichlet Process Mixture Models (High Performance Machine Learning Workshop 2019)

Spark Ray Data Science ⭐ 29

Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with Spark and Ray in the context of a data scientist's standard workflow.

Dask Pytorch Ddp ⭐ 28

dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.

Plinycompute ⭐ 27

A system for development of high-performance, data-intensive, distributed computing, applications, tools, and libraries.

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

Prometheus Spec ⭐ 25

Cryptoeconomically-safe trustless high-load computing on top of Bitcoin

Python for streams

Vodascheduler ⭐ 23

GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster

Apollo: Online Machine Learning for Performance Portability

Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.

Optuna Distributed ⭐ 17

Distributed hyperparameter optimization made easy

Kaleidoscope ⭐ 17

A user toolkit for analyzing and interfacing with Large Language Models (LLMs)

Ml_notebooks ⭐ 17

Collection of machine learning related notebooks to share.

Library for streaming data and incremental learning algorithms.

Construct ⭐ 16

JavaScript Digital Organisms simulator

Pipeedge ⭐ 14

PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices

Distributed Ml Pyspark ⭐ 12

🔨使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机 323课程

Terrytangyuan.github.com ⭐ 11

Python Distributed Non Negative Matrix Factorization with custom clustering

⛰️ RockyML - A High-Performance Scientific Computing Framework for Non-smooth Machine Learning Problems

Hpc.fassr ⭐ 8

High-Performance Computing. Fundamental Analysis Stock Screener and Ranker

Covalent Ssh Plugin ⭐ 8

Executor plugin interfacing Covalent with remote backends using SSH

Databrickstraining ⭐ 6

Repository for Microsoft Databricks Training Events - Hosted by BlueGranite

Skin Cancer Classifier ⭐ 6

Skin cancer classification demo using Federated Learning techniques

Distributed Evolutionary Ml ⭐ 5

A tool for experimenting with evolutionary optimization methods for machine learning algorithms, by distributing the workload over a large number of compute nodes on the IBM Cloud. For now, it only includes an implementation of [Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning](https://arxiv.org/abs/1712.06567).

An autoML for explainable text classification.

System Design For Federated Learning ⭐ 5

Paper list of federated learning: About system design

Rpcdataloader ⭐ 5

A variant of the PyTorch Dataloader using remote workers.

Selective Search ⭐ 5

Selective search partitions large scale dataset into subsets(shards) such that only few shards needs to be searched for a query, thus improving search efficiency and effectiveness

Related Searches

Python Machine Learning (14,099)

Jupyter Notebook Machine Learning (12,247)

Machine Learning Neural Network (4,397)

Machine Learning Tensorflow (4,050)

Machine Learning Natural Language Processing (3,891)

Machine Learning Artificial Intelligence (3,877)

Machine Learning Data Science (3,802)

Machine Learning Pytorch (2,910)

Machine Learning Dataset (2,298)

Machine Learning Computer Vision (1,966)

1-74 of 74 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.