Awesome Open Source

Programming Languages

Search results for distributed computing

distributed-computing x

434 search results found

The Pandata scalable open-source analysis stack

Disbatch ⭐ 31

Tool to distribute a list of computational tasks over a pool of compute resources. The pool can grow or shrink.

Lipizzaner Gan ⭐ 30

[AAAI 2018] "Towards distributed coevolutionary GANs" by Abdullah Al-Dujaili, Tom Schmiedlechner, Erik Hemberg, Una-May O'Reilly

Dpmmsubclusters.jl ⭐ 30

Distributed MCMC Inference in Dirichlet Process Mixture Models (High Performance Machine Learning Workshop 2019)

An abstraction layer for parameter tuning

Spark Ray Data Science ⭐ 29

Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with Spark and Ray in the context of a data scientist's standard workflow.

High-Throughput Computing in Python, powered by HTCondor

Redis Dict ⭐ 29

Python Redis Dictionary. Pythonic wrapper that provides name spacing for everyone favorite caching database Redis.

Golem Js ⭐ 28

TypeScript + NodeJS API for Golem

Dask Pytorch Ddp ⭐ 28

dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.

Learning Distributed Systems ⭐ 28

List to all papers, books, blogs, articles, repos that I come across while studying distributed systems.

Circuit breaker for HTTP requests in Elixir

Plinycompute ⭐ 27

A system for development of high-performance, data-intensive, distributed computing, applications, tools, and libraries.

Archived Sansa Inference ⭐ 27

A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink

ZeroMQ based distributed patterns

Tutorial ⭐ 27

Tutorials to help you build your first Swim app

A next-generation dynamic and high-performance language for AI and IOT with natural born distributed computing ability.

Libhhash ⭐ 26

Automatically exported from code.google.com/p/libhhash

Taskinator ⭐ 26

A simple orchestration library for running complex processes or workflows in Ruby

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

Distributed systems library for making communications through the network easier, while keeping minimalism and flexibility.

Distributedcompute Notes ⭐ 25

分布式计算：分布式数据处理（流计算/批处理）、消息队列、数据仓库

Python for streams

Prometheus Spec ⭐ 25

Cryptoeconomically-safe trustless high-load computing on top of Bitcoin

Parallelutilities.jl ⭐ 25

Fast and easy parallel mapreduce on HPC clusters

Archived Sansa Owl ⭐ 25

SANSA Stack OWL (Web Ontology Language) API

KAR: A Runtime for the Hybrid Cloud

Microcore ⭐ 24

.NET Core framework for inter-service communication

Exploration of a data-flow programming paradigm

Adaptive Scheduler ⭐ 24

Run many functions (adaptively) on many cores (>10k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. 🎉

Network Forensic & Anomaly Detection System; tailored for covert channel/network steganography detection

Data Driven Framework for Distributed Computing in Torch 7

FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learning [ICLR‘23, Best Paper Award at ECCV’22 AROW Workshop]

Open Stream Processing Benchmark ⭐ 24

This repository contains the code base for the Open Stream Processing Benchmark.

Grid Control ⭐ 23

The grid-control job submission tool

Interbit ⭐ 23

To the end of servers

Easydata ⭐ 23

A simple and lightweight database library in python.

Pycondor ⭐ 23

Build and submit workflows to HTCondor in Python

Vodascheduler ⭐ 23

GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster

Distributed ARIMA Models

Cyber Witness ⭐ 22

Decentralized media simulator based on the reporter and witnesses concept. It aims to be an alternative to mass media, surveillance, censorship, fact checkers and centralized control of news.

Mandelbrotgolang ⭐ 22

Distributed computing Mandelbrot implementation using GoLang, gRPC and RayLib

Cs_interview ⭐ 22

「Java学习+面试指南」思维导图，计算机自学指南，包括Java基础、JVM、数据库、mysql、r

Join Sib ⭐ 22

Join Storms In Brewing Community!

Wavebeans ⭐ 21

Audio Processing. On scale.

Powermodelsada.jl ⭐ 21

A package for solving optimal power flow problems using distributed algorithms.

Java implementation of K-Sortable Globally Unique IDs

Apollo: Online Machine Learning for Performance Portability

Shallowspeed ⭐ 21

Small scale distributed training of sequential deep learning models, built on Numpy and MPI.

Distributed System Algorithms Implementation ⭐ 21

Algorithms for implementation of Clock Synchronization, Consistency, Mutual Exclusion, Leader Election

Distributed ⭐ 21

Distributed is a wrapper module that helps developers to make distributed, scaled, replicated and fault-tolerant (with takeover ability) master-slave systems.

deploy Dask.distributed to GridEngine (sge/pbs) cluster systems

Kaleidoscope Sdk ⭐ 20

A user toolkit for analyzing and interfacing with Large Language Models (LLMs)

common runtime environment for distributed programming languages

Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.

Findthemag2 ⭐ 19

A tool to determine optimal projects for Gridcoin & BOINC crunchers. Maximize your magnitude!

Gcmaes.jl ⭐ 19

Gradient-based Covariance Matrix Adaptation Evolutionary Strategy for Real Blackbox Optimization

DevOps code to deploy eScience services

Julia Operators LIbrary

Serpytor ⭐ 18

A distributed, low-code, end-to-end data collection and analysis tool for data folks. Take the pain out of data collection from your pipeline!

Kubetest ⭐ 18

A CLI for distributed execution of tasks on Kubernetes

Jet is a simple OOP, dynamically typed, functional language that runs on the Erlang virtual machine (BEAM). Jet's syntax is Ruby-like syntax.

Cyber Acid ⭐ 18

Liquid democracy political simulator based on the automated data feed from the moneyless economy simulator Cyber Stasis.

Mesos Pinspider ⭐ 18

A framework called "pinspider" on Apache mesos, to get basic user information from a pinterest page of a user.

Carp.core Kotlin ⭐ 18

Infrastructure-agnostic framework for distributed data collection.

MuPIF is open-source, modular, distributed, object-oriented integration platform allowing to create complex, distributed, multiphysics simulation workflows across the scales and processing chains by combining existing simulation tools. Platform comes with data management system allowing to build digital twin representations of physical systems.

Optuna Distributed ⭐ 17

Distributed hyperparameter optimization made easy

Ml_notebooks ⭐ 17

Collection of machine learning related notebooks to share.

Simple shared surface streaming application

Federated Learning And Split Learning With Raspberry Pi ⭐ 17

SRDS 2020: End-to-End Evaluation of Federated Learning and Split Learning for Internet of Things

Atomizer ⭐ 17

Imagine thousands of machines across multiple cloud instances and data centers executing simultaneous processing for you with minimal deployment effort. Enter Atomizer - a Go library that facilitates massively parallel and distributed computing. Fashioned after Go itself using similar CSP paradigms.

Banyan Julia ⭐ 17

A suite of familiar Julia APIs for bigger datasets with less cloud and lower costs.

Kaleidoscope ⭐ 17

A user toolkit for analyzing and interfacing with Large Language Models (LLMs)

Dicodile ⭐ 16

Experiments for "Distributed Convolutional Dictionary Learning (DiCoDiLe): Pattern Discovery in Large Images and Signals"

MPI bindings for Haskell

Ciphercompute ⭐ 16

The free EAP version of the Cosmian Collaborative Confidential Computing platform. Try it!

Construct ⭐ 16

JavaScript Digital Organisms simulator

Library for streaming data and incremental learning algorithms.

Client_side_validation ⭐ 16

Standard implementation of client-side-validation APIs

Agentworkbench ⭐ 16

Application toolkit based on the JADE framework. Functionalities for time aspects, agent environment interaction, visualization and load balancing, focusing on the usability for end users.

One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework

This is an event-driven asynchronous component model developed in Python. This library can be used to design and implement component-based ad hoc and distributed computing models and algorithms.

Global Mesh Computing

An implementation of the Raft consensus protocol.

Sadlydistributed ⭐ 15

Distributing your code(soul), in almost any language(state), among a cluster of idle browsers(voids)

Zio Maelstrom ⭐ 15

Learn distributed systems in Scala using ZIO and Maelstrom

Angorapy ⭐ 15

Build Goal-driven Models of the Sensorimotor Cortex with Ease.

Slurmclustermanager.jl ⭐ 14

julia package for running code on slurm clusters

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

Distributed Go ⭐ 14

Source code for examples in Distributed Computing with Go

Go Azuremutex ⭐ 14

Golang implementation of distributed mutex on Azure lease blobs

Pipeedge ⭐ 14

PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices

Phatcrack ⭐ 14

Modern web-based distributed hashcracking solution, built on hashcat

Distributed Data Structures ⭐ 13

[GSoC] Distributed Data Structures - Collections Framework for Chapel language

Hydra Hpp ⭐ 13

Hydra Hot Potato Player (game)

distributed nonnegative matrix factorization methods

Distributed Pi ⭐ 13

Calculate Pi using distributed computing with JavaScript on Appengine

Distri.js ⭐ 13

Distributed computing for the browser

Infrastructure for providing secured micro services, that are dynamically discoverable and searchable over ipv6 networks

pyABC: distributed, likelihood-free inference

201-300 of 434 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.