Awesome Open Source

Programming Languages

Search results for python distributed computing

distributed-computing x

146 search results found

Library for streaming data and incremental learning algorithms.

One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework

Dicodile ⭐ 16

Experiments for "Distributed Convolutional Dictionary Learning (DiCoDiLe): Pattern Discovery in Large Images and Signals"

This is an event-driven asynchronous component model developed in Python. This library can be used to design and implement component-based ad hoc and distributed computing models and algorithms.

Angorapy ⭐ 15

Build Goal-driven Models of the Sensorimotor Cortex with Ease.

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

Pipeedge ⭐ 14

PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices

pyABC: distributed, likelihood-free inference

Distributed Ml Pyspark ⭐ 12

🔨使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机 323课程

Dask Saturn ⭐ 12

Python library for interacting with Dask clusters in Saturn

Web based cluster computing apps

An instant distributed computing library based on Ray Train and Ray Data

Icml 2023 Dsgd And Sam ⭐ 11

[ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent

Terrytangyuan.github.com ⭐ 11

Pandas Farm ⭐ 11

Parallelize pandas operations easily on your personal small cluster

Simple_distribute_job ⭐ 10

Simple distribute job scheduler for multiple servers with only SSH. No additions.

Python Distributed Non Negative Matrix Factorization with custom clustering

Hash_framework ⭐ 10

Framework for studying cryptographic hash functions using SAT.

Hyper Shell ⭐ 10

A cross-platform, high-performance computing utility for processing shell commands over a distributed, asynchronous queue.

Experiments for ICML paper DICOD: Distributed Convolutional Coordinate Descent for Convolutional Sparse Coding, ICML 2018, T. Moreau, L. Oudre, N. Vayatis.

WRF Modeling System on Distributed Computing Infrastructures

A celery like jobs framework for managing and distributing async / non-async tasks

Distributed Competetive Coding Platform

Hpc.fassr ⭐ 8

High-Performance Computing. Fundamental Analysis Stock Screener and Ranker

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Pdf2dataset ⭐ 8

Converts a whole subdirectory with a big (or small) volume of PDF documents to a dataset (pandas DataFrame) with error tracking and choice of features

Covalent Ssh Plugin ⭐ 8

Executor plugin interfacing Covalent with remote backends using SSH

A compilation of codes for SMA, DC, ADS

Findthemag ⭐ 7

A tool to determine optimal projects for Gridcoin crunchers. Maximize your magnitude!

Distributed Computing And Distributed Computing Lab ⭐ 7

CSC802: Distributed Computing [DC] & CSL802: Distributed Computing Lab [DC Lab] <Semester VIII>

Real-time interferometric data analysis for the VLA

Opencluster ⭐ 6

Python Distributed Computing API

Distributed Ecosystem ⭐ 6

Planned tools for making pipeline development and data reproduction easier

Icml 2023 Fedlaw ⭐ 6

The is the official implementation of ICML 2023 paper "Revisiting Weighted Aggregation in Federated Learning with Neural Networks".

Databrickstraining ⭐ 6

Repository for Microsoft Databricks Training Events - Hosted by BlueGranite

Spark Utils ⭐ 6

Comfy Utilities for Spark Job Authoring

Distributed processing with NumPy and Zarr

Pycompss Autoparallel ⭐ 6

PyCOMPSs AutoParallel

Smart Calibration ⭐ 5

Deep reinforcement learning for smart calibration of radio telescopes. Automatic hyper-parameter tuning.

Swarming is a Python3 library that features both parallel and serial implementation of the Particle Swarm Optimization (PSO) algorithm.

Py Inventa ⭐ 5

A Python library for microservice registry and executing RPC (Remote Procedure Call) over Redis.

Scalable Cytometry Image Processing (SCIP) is an open-source tool that implements an image processing pipeline on top of Dask, a distributed computing framework written in Python. SCIP performs projection, illumination correction, image segmentation and masking, and feature extraction.

Flexible Learning-Free Reconstruction of Neural Circuits

Rpcdataloader ⭐ 5

A variant of the PyTorch Dataloader using remote workers.

Distributed Evolutionary Ml ⭐ 5

A tool for experimenting with evolutionary optimization methods for machine learning algorithms, by distributing the workload over a large number of compute nodes on the IBM Cloud. For now, it only includes an implementation of [Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning](https://arxiv.org/abs/1712.06567).

An autoML for explainable text classification.

Related Searches

Python Machine Learning (20,195)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Pytorch (7,877)

Python Convolutional Neural Networks (6,998)

Python Keras (6,821)

101-146 of 146 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.