Awesome Open Source

Programming Languages

Search results for python parallel computing

parallel-computing x

107 search results found

Joblib ⭐ 3,543

Computing with Python functions.

Swifter ⭐ 2,407

A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner

Geatpy ⭐ 1,633

Evolutionary algorithm toolbox and framework with high performance for Python

Adaptive ⭐ 1,079

📈 Adaptive: parallel active learning of mathematical functions

Pyopencl ⭐ 1,021

OpenCL integration for Python, plus shiny features

Kratos Multiphysics (A.K.A Kratos) is a framework for building parallel multi-disciplinary simulation software. Modularity, extensibility and HPC are the main objectives. Kratos has BSD license and is written in C++ with extensive Python interface.

A C++ platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

Python bindings for MPI

GRASS GIS - free and open-source geospatial processing engine

Numba extension for compiling Pandas data frames, Intel® Scalable Dataframe Compiler

Hyperactive ⭐ 475

An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.

Parallel programming with Python

A framework for high-performance medical image processing, neural network inference and visualization

Particle-in-cell code for plasma simulation

Pyhpc Benchmarks ⭐ 290

A suite of benchmarks for CPU and GPU performance of the most popular high-performance libraries for Python 🚀

Distributed and Parallel Computing Framework with / for Python

Comfortable parallel TQDM using concurrent.futures

Step_into_llm ⭐ 211

MindSpore online courses: Step into LLM

Estimagic ⭐ 204

Estimagic is a Python package for nonlinear optimization with or without constraints. It is particularly suited to solve difficult nonlinear estimation problems. On top, it provides functionality to perform statistical inference on estimated parameters.

Bohrium ⭐ 202

Automatic parallelization of Python/NumPy, C, and C++ codes on Linux and MacOSX

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

C and Python examples from my book on using PETSc and Firedrake to solve PDEs

Distributed Keras Engine, Make Keras faster with only one line of code.

Python wrapper for MFEM

Brutalityextractor ⭐ 160

适用于高性能系统的多进程解压缩软件(A multiprocess decompression software for high-performance system)

Ultranest ⭐ 119

Fit and compare complex models reliably and rapidly. Advanced nested sampling.

Torchimize ⭐ 110

numerical optimization in pytorch

Distributed process pool for Python

Fast Poisson Image Editing ⭐ 101

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Lsf Python Api ⭐ 98

Location for the LSF Python wrapper for controlling all things LSF

Spark With Python ⭐ 98

Fundamentals of Spark with Python (using PySpark), code examples

Bulk summarization of documents using ChatGPT API

Nbodykit ⭐ 93

Analysis kit for large-scale structure datasets, the massively parallel way

Psyclone ⭐ 92

Domain-specific compiler and code transformation system for Finite Difference/Volume/Element Earth-system models in Fortran

Soft Actor Critic And Extensions ⭐ 87

PyTorch implementation of Soft-Actor-Critic and Prioritized Experience Replay (PER) + Emphasizing Recent Experience (ERE) + Munchausen RL + D2RL and parallel Environments.

Schwimmbad ⭐ 82

A common interface to processing pools.

Mltoolkits ⭐ 65

learningOrchestra is a distributed Machine Learning integration tool that facilitates and streamlines iterative processes in a Data Science project.

Python Wrapper for Message-Oriented and Robotics Middleware

A High-Performance Data Science Toolkit for the Earth Sciences

Opensbli ⭐ 61

A framework for the automated derivation and parallel execution of finite difference solvers on a range of computer architectures.

Quad/octree building for FMMs in Python and OpenCL

Tensorpac ⭐ 59

Phase-Amplitude Coupling under Python

Taichi Fluid ⭐ 57

A collection of CFD related resources for Taichi developers.

Pythonframeworks ⭐ 49

Another curated list of Python frameworks

Mpi4py Fft ⭐ 41

mpi4py-fft is a Python package for computing Fast Fourier Transforms (FFTs).

Ps_pytorch ⭐ 40

implement distributed machine learning with Pytorch + OpenMPI

Transcode source media directly from DaVinci Resolve using multiple machines for encoding. Great for creating proxies quickly.

Topopt_in_petsc_wrapped_in_python ⭐ 34

Topology optimization using PETSc: a Python wrapper and extended functionality

Madpy Dask ⭐ 34

MadPy Dask talk materials

Modeling molecular ensembles with scalable data structures and parallel computing

Topo Fenics ⭐ 30

This repository contains a simple 55 lines code to carry out large scale parallel Topology Optimization using FEniCS in python

Nostradamus ⭐ 29

Backtesting an algorithmic trading strategy using Machine Learning and Sentiment Analysis.

A Python framework for developing parallelized Computational Fluid Dynamics software to solve the hyperbolic 2D Euler equations on distributed, multi-block structured grids.

pySDC is a Python implementation of the spectral deferred correction (SDC) approach and its flavors, esp. the multilevel extension MLSDC and PFASST.

PACT: A Parallel Compact Thermal Simulator

Multi-threaded Optimization Toolbox

Framework for storing, visualizing, and processing Universal Spectroscopic and Imaging Data (USID)

Propulate ⭐ 24

Propulate is an asynchronous evolutionary optimization algorithm and software package for global optimization and hyperparameter search on high-performance computers.

Adaptive Scheduler ⭐ 24

Run many functions (adaptively) on many cores (>10k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. 🎉

A parallel framework for training deep neural networks

Pararealml ⭐ 19

A machine learning boosted parallel-in-time differential equation solver framework.

Training of Neural Network using Particle Swarm Optimization

Efficient parallelizable algorithms for multidimensional arrays to speed up your data pipelines

Optuna Distributed ⭐ 17

Distributed hyperparameter optimization made easy

Grokking_concurrency ⭐ 16

"Grokking Concurrency" book code examples

DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

Rayenvwrapper ⭐ 15

OpenAi's gym environment wrapper to vectorize them with Ray

spark (scala and python)

Bzcompute ⭐ 14

bzCompute is a computation graph library with built-in support for domain-decomposition and prallel computation. The library can be used for expressing and executing large number of mathematical and text-processing operations using Data-Flow graphs, (Educational version of tensorflow), written in pure python code with numpy support.

Upsp Processing ⭐ 14

Software for processing high-speed video recordings from Unsteady Pressure-Sensitive Paint (UPSP) measurement systems. https://nasa.github.io/upsp-processing

Flow Physics and Aeroacoustics Toolbox with Python

pyABC: distributed, likelihood-free inference

Fastcolabcopy ⭐ 13

Fast Multi-Threaded Google Colab File Transfering

Python Performance ⭐ 12

Repository for the book Fast Python - published by Manning

Gravitation ⭐ 12

n-body-simulation performance test suite

Convolution Neural Network By Pycuda ⭐ 12

pyCUDA implementation of forward propagation for Convolutional Neural Networks

Ftpwalker ⭐ 12

PyPI package for traversing extremely large FTP directory trees

Cortix is a Python library for network dynamics modeling and HPC simulation.

Parallelgso ⭐ 11

A highly scalable parallel version of Galactic Swarm Optimisation Algorithm

Balanced_graph_partitioning ⭐ 10

Implementation of Balanced Graph Partitioning Konstantin" - Andreev and Harald Racke (Authors of the paper) by Ivan Vigorito and Lorenzo Frigerio

Torchspectralgating ⭐ 10

TorchSpectralGate is a PyTorch-based implementation of Spectral Gating, an algorithm for denoising audio signals.

Pyrallel ⭐ 10

Yet another easy-to-use python3 parallel library for humans.

Parallel Delaunay ⭐ 10

Parallel implementation of Guibas & Stolfi's divide-and-conquer algorithm for Delaunay triangulation, using MPI in Python.

Interactive ML Toolset

Julia and Python programs that implement some of the tools described in my book "Stochastic Methods in Asset Pricing" (SMAP), MIT Press 2017 (e.g., the method for computing the price of American call options and the construction of the early exercise premium in the Black-Scholes-Merton framework from section 18.4 in SMAP).

Object-Oriented distance-independent Individual Tree Simulator (TreeSim)

Duplicate Images Detection Using Parallel Processing ⭐ 9

Detect Duplicate Images Blazingly Fast

Ensemble_md ⭐ 9

A python package for performing GROMACS simulation ensembles

Concurrency Patterns ⭐ 9

Concurrency Patterns Implemented in Python

Autoemcee ⭐ 8

Run MCMC automatically to convergence

Inpainting Gpu ⭐ 8

Image Inpainting implementation. Parallel Computing Accelerated Image Inpainting using GPU CUDA, Theano, and Tensorflow.

Pymdsetup ⭐ 8

Big Data Analysis With Python ⭐ 8

Combine Spark and Python to process large datasets and unlock the power of parallel computing and machine learning

Nodeallocator ⭐ 7

A resource broker tool for MPI programs in a shared cluster, considering the current compute load and available network bandwidths.

A Highlevel Python Wrapper for Vulkan's Compute API

Dask Azureblobfs ⭐ 7

Azure Blob Storage FileSystem backend for Dask

Multiprocessing_in_python ⭐ 7

Multiprocessing in python

Optimized and benchmarked parallel Genetic Algorithm with inequality constraints, and a scipy-like interface

Asynch Mb ⭐ 6

Asynchronous methods for model-based reinforcement learning.

A python module for GPU device info by using nvidia-smi and assign DL tasks to GPU device automatically and execute parallelly

Related Searches

Python Django (28,897)

Python Machine Learning (14,099)

Python Tensorflow (13,736)

Python Deep Learning (13,092)

Python Algorithms (10,033)

Python Natural Language Processing (9,064)

Python Artificial Intelligence (8,580)

Python Pytorch (7,877)

Python Keras (6,821)

Python Pandas (6,193)

1-100 of 107 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.