Awesome Open Source

Programming Languages

Search results for python parallelism

71 search results found

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

A Python stream processing engine modeled after Yahoo! Pipes

Mesh TensorFlow: Model Parallelism Made Easier

Syntax_sugar_python ⭐ 730

A library adding some anti-Pythonic syntatic sugar to Python

Extended Memory Semantics - Persistent shared object memory and parallelism for Node.js and Python

A code generator for array-based code on CPUs and GPUs

B2_command_line_tool ⭐ 512

The command-line tool that gives easy access to all of the capabilities of B2 Cloud Storage

Fastfold ⭐ 485

Optimizing AlphaFold Training and Inference on GPU Clusters

Torchgpipe ⭐ 479

A GPipe implementation in PyTorch

Async Techniques Python Course ⭐ 407

Async Techniques and Examples in Python Course

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

Pipedream ⭐ 239

Platoon ⭐ 198

Multi-GPU mini-framework for Theano

Distributed Keras Engine, Make Keras faster with only one line of code.

Experimental Gradient Boosting Machines in Python with numba.

PyClaw is a Python-based interface to the algorithms of Clawpack and SharpClaw. It also contains the PetClaw package, which adds parallelism through PETSc.

Distributed Tensorflow Example ⭐ 125

An example of data parallelism and async updates of parameter in tensorflow.

Butterfly Backup ⭐ 111

Butterfly Backup is a simple command line wrapper of rsync for complex task, written in python.

Chocolate ⭐ 101

A fully decentralized hyperparameter optimization framework

Deep Learning With Pytorch A 60 Minute Blitz Cn ⭐ 95

PyTorch1.0 深度学习：60分钟入门与实战（Deep Learning with PyTorch: A 60 Minute Blitz 中文翻译与学习）

Run:AI Python library

Paramgmt ⭐ 81

A parallel SSH-based remote machine management system

Dask Geopandas ⭐ 80

Parallelized GeoPandas with Dask

Gdal2tilesp ⭐ 59

Enhancements to tile cutter for parallelism and image format support

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Pipelinewise Target Snowflake ⭐ 50

Singer.io Target for Snowflake - PipelineWise compatible

Detectmaliciousurl ⭐ 48

Applying text model to Detection Task

distributed tox (tox plugin to run testenvs in parallel)

Django Batch Requests ⭐ 36

Combine multiple http requests into a single batch request.

Pyreshaper ⭐ 34

A package for converting NetCDF files from time-slice (history) format to time-series (single-variable) format.

Discopop ⭐ 31

DiscoPoP - Discovery of Potential Parallelism

Parallel_python ⭐ 30

Parallel Programming with Python Tutorial

Mpi4pyscf ⭐ 29

MPI parallelization for PySCF

Parallel_python ⭐ 28

Code for Python Parallel Programming Cookbook by Giancarlo Zaccone

Multissh ⭐ 25

A multiprocessed library written in Python and utilising Paramiko.

Pytest Circleci Parallelized ⭐ 24

Parallelize pytest across CircleCI workers.

Lets Golang ⭐ 20

Pytest Shard ⭐ 19

Shard tests to support parallelism across multiple machines.

Pipelinewise Target Postgres ⭐ 18

Singer.io Target for PostgreSQL - PipelineWise compatible

Async Channel ⭐ 16

Python async multi-task communication library. Used by OctoBot project.

torcpy is a platform-agnostic adaptive load balancing library that orchestrates the scheduling of task parallelism on both shared and distributed memory platforms.

Pyeventbus ⭐ 13

Python Eventbus

Divisive Intelligent K-Means algorithm (DiviK) for joint feature selection and clustering of heavily multidimensional data.

Modelparallel_pytorch ⭐ 12

Model Parallelism for pytorch training multiple network on multiple GPUs.

Python Parallelize ⭐ 12

Simple fork/join parallelism with Python's for loop

Rse18 Python Parallel Workshop ⭐ 11

Tutorials/workshop material for the Parallelism with Python RSE18+EuroSciPy workshop

Py_vb_toolbox ⭐ 11

Vogt-Bailey index toolbox in Python

Dask Memusage ⭐ 11

A low-impact profiler to figure out how much memory each task in Dask is using

Parallel_closest_object_search ⭐ 10

Parallel search algorithm for finding the closest object in a collection of polygonal models based on Hausdorff Distance with implementation using MPI in Python

Pipelinewise Target Redshift ⭐ 10

Singer.io Target for Amazon Redshift - PipelineWise compatible

Satellitetracker ⭐ 9

📡 A Python program to track the location of the ISS and other satellites

Python Mosaic ⭐ 9

A simple tool to add mosaic effect to images

Remote function calls for array data using ZMQ

Devops Schedule ⭐ 9

how do you order a tree of work correctly where there are dependencies between works

PyMGRIT is a package for the Multigrid-Reduction-in-Time (MGRIT) algorithm in Python.

A small batch processing utlity

An Efficient Pipelined Data Parallel Approach for Training Large Model

Onceforever ⭐ 8

This repository holds codes that I wrote them in once for ever articles at https://virgool.io/@GreatBahram

Connects microservices through a mesh of websockets

Galibrate ⭐ 8

Parameter estimation and model calibration using Genetic Algorithm optimization in Python.

Plumbing for Optimization with Asynchronous Parallelism

Perform your python tasks in parallel.

A python library for (mostly) embarrasingly easy parallism

Snakefish ⭐ 6

parallel Python

Jobmanager ⭐ 6

easy distributed computing based on the python class SyncManager for remote communication and python module multiprocessing for local parallelism

Parallel Youtube Titles To Mp3 ⭐ 6

Search and download a list of videos from Youtube in Parallel and convert them to mp3 along with their metadata and thumbnails

Nevergrad4sf ⭐ 5

Optimize stockfish parameters using nevergrad

Pear - a Python package for writing multithreaded code and parallelizing tasks across CPU threads.

Clone-specific genomic structure estimation in cancer

Encoder Aas ⭐ 5

An architecture providing Universal Sentence Encoder as a service by exploiting job-level parallelism of multi-core architectures. The service can be used as a transformer model for downstream NLP and NLU tasks like Language modelling, Sentiment Classification, Question Answering, Semantic Search and more.

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Algorithms (10,033)

Python Pytorch (7,877)

Python Neural (7,444)

Python Keras (6,821)

1-71 of 71 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.