Awesome Open Source

Programming Languages

Search results for python distributed systems

distributed-systems x

152 search results found

Ddia ⭐ 18,778

《Designing Data-Intensive Application》DDIA中文翻译

Petals ⭐ 8,040

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Faust ⭐ 6,637

Python Stream Processing

Translations ⭐ 6,612

🐼 Chinese translations for classic IT resources

Build powerful pipelines in any programming language.

Di Engine ⭐ 2,681

OpenDILab Decision AI Engine

Fugue ⭐ 1,821

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Hivemind ⭐ 1,716

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

High-Performance Symbolic Regression in Python and Julia

System Design Questions ⭐ 1,496

Problem statements on System Design and Software Architecture as part of Arpit's System Design Masterclass

Faststream ⭐ 1,485

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

Eventsourcing ⭐ 1,387

A library for event sourcing in Python.

Faust ⭐ 1,330

Python Stream Processing. A Faust fork

Py4J enables Python programs to dynamically access arbitrary Java objects

Vizier ⭐ 1,142

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

GNES is Generic Neural Elastic Search, a cloud-native semantic search system based on deep neural network.

Ray Llm ⭐ 972

RayLLM - LLMs on Ray

Xorbits ⭐ 946

Scalable Python DS & ML, in an API compatible & lightning fast way.

Blockade ⭐ 903

Docker-based utility for testing network failures and partitions in distributed applications

Bagua Speeds up PyTorch

Gunnery ⭐ 728

Remote task execution tool

Pyro 4.x - Python remote objects

Elasticdl ⭐ 710

Kubernetes-native Deep Learning Framework

Pysyncobj ⭐ 660

A library for replicating your python class between multiple servers, based on raft protocol

A programmable, observable and distributed job orchestration system.

iWF is an API orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

Sherlock ⭐ 367

Easy distributed locks for Python with a choice of backends.

Adaptdl ⭐ 339

Resource-adaptive cluster scheduler for deep learning training.

Rd Blender Docker ⭐ 330

A collection of Docker containers for running Blender headless or distributed ✨

Thespian ⭐ 289

Python Actor concurrency library

Timecraft ⭐ 288

The WebAssembly Time Machine

Distributed Ml Patterns ⭐ 270

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

Pyro 5 - Python remote objects

Distributed LMS for automating Computing Science Courses From NYU

Chat.petals.dev ⭐ 240

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

Tractor ⭐ 235

A distributed, structured concurrent runtime for Python (and friends)

Rucio - Scientific Data Management

Distributed Keras Engine, Make Keras faster with only one line of code.

Skale Network ⭐ 130

Handling millions of transactions per week, SKALE is a multichain network composed of an unlimited number of secure, decentralized, high-performance Ethereum Native Blockchains

Can Bootloader ⭐ 124

The bootloader used to flash our CAN-connected boards

Hypertrade ⭐ 108

Ready to deploy, distributed cryptocurrency trading bot

The memo elastic and resilient key-value store.

🚗 Rocket League Distributed Deep Reinforcement Learning Bot

Python implementation of the Raft algorithm for distributed consensus

Gossip Python ⭐ 97

Implementation of the gossip protocol

A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu

Autodist ⭐ 92

Simple Distributed Deep Learning on TensorFlow

Checkmate ⭐ 90

Training neural networks in TensorFlow 2.0 with 5x less memory

Saturn accelerates the training of large-scale deep learning models with a novel joint optimization approach.

Supvisors ⭐ 81

Supvisors: A Control System for Distributed Applications

Distbelief ⭐ 79

Implementing Google's DistBelief paper

Hystrix Py ⭐ 75

Latency and fault tolerance for distributed systems

Farm operated by bots to grow and harvest new zim files

A simple task queue implementation to enqeue jobs on local or remote processes.

Toolkit for graph-relational data across space and time

Distributed_rl ⭐ 66

Pytorch implementation of distributed deep reinforcement learning

A high-performance distributed deep learning system targeting large-scale and automated distributed training.

Tensordiffeq ⭐ 60

Efficient and Scalable Physics-Informed Deep Learning and Scientific Machine Learning on top of Tensorflow for multi-worker distributed computing

Garfield ⭐ 60

An offensive attack framework for Distributed Layer of Modern Applications

Python data pipeline

Remote Dataloader ⭐ 55

PyTorch DataLoader processed in multiple remote computation machines for heavy data processings

Ray_tutorial ⭐ 55

An introductory tutorial about leveraging Ray core features for distributed patterns.

Python Json Socket ⭐ 53

JSON messaging based socket interface with multi-threaded server and client

Distributed Learning by Pair-Wise Averaging

🧘‍♀️ Lightweight fault tolerant primitives for your modern asyncio Python microservices

Ps_pytorch ⭐ 40

implement distributed machine learning with Pytorch + OpenMPI

Django Concurrency Talk ⭐ 38

🎭 Database Integrity in Django: Safely Handling Critical Data in Distributed Systems

Autocomplete System ⭐ 36

Restful Autocomplete service with Neo4j graph backend. Returns top suggestions.

Lstm Tensorspark ⭐ 35

Implementation of a LSTM with TensorFlow and distributed on Apache Spark

Wind是一款面向云的高性能、高效率以及高扩展性的分布式游戏服务器引擎框架

An abstraction layer for parameter tuning

Distributex ⭐ 30

A POC of a federated architecture using HTMX & NGINX - micro-frontends/services (same thing)

Redis Dict ⭐ 29

Python Redis Dictionary. Pythonic wrapper that provides name spacing for everyone favorite caching database Redis.

Ijcai2023 Optimalshardeddataparallel ⭐ 29

[IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any interests, please visit/star/fork https://github.com/Youhe-Jiang/OptimalShardedDataP

Wfcommons ⭐ 28

WfCommons: A Framework for Enabling Scientific Workflow Research and Development

Docker Airflow ⭐ 28

Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/

Openagent ⭐ 27

An agent library for systems of nested automata.

Federated Model Aggregation ⭐ 26

The Federated Model Aggregation (FMA) Service is a collection of installable python components that make up the generic workflow/infrastructure needed for federated learning.

A static scheduling heuristic

Fedadapt ⭐ 26

Adaptive Offloading of Federated Learning on IoT Devices

Distributed Inference ⭐ 26

A project to demonstrate an approach to designing cross-language and distributed pipeline in deep learning/machine learning domain, using WebRTC and Redis Streams.

A next-generation dynamic and high-performance language for AI and IOT with natural born distributed computing ability.

Python for streams

Cmps128 Fall18 ⭐ 24

Easydata ⭐ 23

A simple and lightweight database library in python.

Koboldai Horde Bridge ⭐ 23

Turns KoboldAI into a crowdsourced distributed cluster

Hapi is a Python library for building Conceptual Distributed Model using HBV96 lumped model & Muskingum routing method

ARAKAT - Big Data Analysis and Business Intelligence Application Development Platform

Framework for Java and Groovy Agents

Funnelkvs ⭐ 21

Rust implementation of autonomous distributed key-value store which has REST interfaces

Makinage ⭐ 21

Stream Processing Made Easy

Automation Test Framework For Distributed Systems

Serpytor ⭐ 18

A distributed, low-code, end-to-end data collection and analysis tool for data folks. Take the pain out of data collection from your pipeline!

Distributed DataLoader For Pytorch Based On Ray

Blazingmq Sdk Python ⭐ 17

Python SDK for BlazingMQ, a modern high-performance open source message queuing system.

Rraft Py ⭐ 17

Unofficial Python Binding of the tikv/raft-rs

One RL Platform is all you need -- Event-driven fully distributed reinforcement learning framework

Blockchainengineering ⭐ 16

Learn to think like a blockchain designer by solving practical challenges

An easy to use rpc framework for enabling fast inter-process, inter-container, or inter-host communication

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Flask (17,643)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Command Line (13,351)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

1-100 of 152 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.