Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for python slurm
python
x
slurm
x
166 search results found
Ml Engineering
⭐
6,720
Machine Learning Engineering Open Book
Submitit
⭐
980
Python 3.8+ toolbox for submitting jobs to Slurm
Toil
⭐
860
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
Pytorch Distributed
⭐
859
A quickstart and benchmark for pytorch distributed training.
Pyslurm
⭐
449
Python Interface to Slurm
Coref
⭐
398
BERT for Coreference Resolution
Elasticluster
⭐
334
Create clusters of VMs on the cloud and configure them with Ansible.
Carbontracker
⭐
305
Track and predict the energy consumption and carbon footprint of training deep learning models.
Torchx
⭐
275
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Batch Shipyard
⭐
270
Simplify HPC and Batch workloads on Azure
Dask Jobqueue
⭐
229
Deploy Dask on job schedulers like PBS, SLURM, and SGE
Eli5
⭐
220
Scripts and links to recreate the ELI5 dataset.
Seml
⭐
153
SEML: Slurm Experiment Management Library
Ipython Cluster Helper
⭐
145
Tool to easily start up an IPython cluster on different schedulers.
Milano
⭐
127
Milano is a tool for automating hyper-parameters search for your models on a backend of your choice.
Hypertunity
⭐
114
A toolset for black-box hyperparameter optimisation.
Ansible Playbooks
⭐
102
ansible playbooks for GC3
Slurm_gpustat
⭐
82
A simple command line tool to show GPU usage on a SLURM cluster
Docker Centos7 Slurm
⭐
81
Slurm Docker Container on CentOS 7
Coldfront
⭐
79
HPC Resource Allocation System
Slurm Mail
⭐
76
Slurm-Mail is a drop in replacement for Slurm's e-mails to give users much more information about their jobs compared to the standard Slurm e-mails.
Start_follow_read
⭐
76
Slurmpy
⭐
71
submit jobs to slurm with quick-and-dirty python
Xyzpy
⭐
64
Efficiently generate and analyse high dimensional data.
Quickstart
⭐
61
https://tacc.ust.hk
Kernel Gof
⭐
56
NeurIPS 2017 best paper. An interpretable linear-time kernel goodness-of-fit test.
Slurm Examples
⭐
53
Distributed Ba3c
⭐
51
Ensembl Hive
⭐
50
EnsEMBL Hive - a system for creating and running pipelines on a distributed compute resource
Slurm Pipeline
⭐
47
A Python class for scheduling SLURM jobs
Cyclecloud Slurm
⭐
45
Azure CycleCloud project to enable users to create, configure, and use Slurm HPC clusters.
Easyquake
⭐
45
Simplified machine-learning driven earthquake detection, location, and analysis.
Slurmmon
⭐
44
gather and plot data about Slurm scheduling and job statistics
Interpretable Test
⭐
44
NeurIPS 2016. Linear-time interpretable nonparametric two-sample test.
Wandb_on_slurm
⭐
43
Example of how to use Weights & Biases on Slurm
Soopervisor
⭐
42
☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
Caper
⭐
41
Cromwell/WDL wrapper for Python
Slurm Magic
⭐
41
IPython magic for SLURM.
Tensorflow_on_slurm
⭐
40
Compss
⭐
39
COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.
Ai2 Kit
⭐
36
A toolkit featured artificial intelligence × ab initio for computational chemistry research.
Dpdispatcher
⭐
36
generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish
Cluster Workers
⭐
35
a Python client/master/worker system for distributing jobs in a cluster
Disbatch
⭐
31
Tool to distribute a list of computational tasks over a pool of compute resources. The pool can grow or shrink.
Slurm Utils
⭐
31
A few utilities for use on a SLURM cluster
Usegalaxy Playbook
⭐
31
Ansible Playbook for usegalaxy.org
Wochenende
⭐
30
Deprecated see https://github.com/MHH-RCUG/nf_wochenende : A whole Genome/Metagenome Sequencing Alignment Pipeline in Python3
Aws Hpc Recipes
⭐
29
Contains example recipes that demonstrate how to build HPC systems using AWS services and solutions.
Imagery_utils
⭐
29
Zeldarose
⭐
27
Train transformer-based models.
Covalent Slurm Plugin
⭐
26
Executor plugin interfacing Covalent with Slurm
Python
⭐
24
Example Python Scripts
Clusterfutures
⭐
24
super-slick Slurm and Condor cluster execution for Python
Stag Mwc
⭐
24
StaG Metagenomic Workflow Collaboration
Qbatch
⭐
24
Adaptive Scheduler
⭐
24
Run many functions (adaptively) on many cores (>10k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. 🎉
Paralleltask
⭐
23
A simple and lightweight parallel task engine
Qhub Hpc
⭐
22
Yaspi
⭐
22
yaspi - Yet Another Slurm Python Interface
Bioinformaticsintroduction
⭐
22
Slurm Job Exporter
⭐
21
Prometheus exporter for the stats in the cgroup accounting with slurm. This will also collect stats of a job using NVIDIA GPUs.
Clues
⭐
21
CLUES: an energy management system for HPC Clusters and Cloud infrastructures.
Nes
⭐
20
Neural Ensemble Search for Uncertainty Estimation and Dataset Shift
Slurmspawner
⭐
19
Custom Spawner for Jupyterhub to start slurm jobs when users log in
Sparkhpc
⭐
19
launching and controlling spark on hpc clusters
Kpnn
⭐
18
Knowledge-primed neural networks
Socker
⭐
18
A wrapper for secure running of Docker containers on Slurm
Skynet Ddp Slurm Example
⭐
18
Example of using PyTorch DistributedDataParallel and SLURM on skynet
Rnaseq Pipeline
⭐
18
RNA-seq pipeline for raw sequence alignment and transcript/gene quantification.
Clara
⭐
17
Cluster Administration tools
Aws Eda Slurm Cluster
⭐
17
AWS Slurm Cluster for EDA Workloads
Fyrd
⭐
17
Submit functions and shell scripts to torque and slurm clusters or local machines using python.
Alphafold_singularity
⭐
17
Singularity recipe for AlphaFold
Slurm_gpu_ubuntu
⭐
16
Instructions for setting up a SLURM cluster using Ubuntu 18.04.3 with GPUs.
Hapsolo
⭐
15
Reduction of Althaps and Duplicate Contigs for Improved Hi-C Scaffolding
Cadee
⭐
15
CADEE: Computer-Aided Directed Evolution of Enzymes
Fsic Test
⭐
15
ICML 2017. Kernel-based adaptive linear-time independence test.
Poretally
⭐
15
Benchmark MinION assembler pipelines and publish your results in a heartbeat!
Mushroom Rl Benchmark
⭐
14
Benchmarking suite for MushroomRL Deep RL algorithms
Popsycle
⭐
14
Population Synthesis for Compact-object Lensing Events
Pyslurm
⭐
14
Pysqa
⭐
13
Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.
Apel
⭐
13
APEL client and server source code.
Slurmjobs
⭐
13
Automating Slurm job generation.
Slurmtools
⭐
13
Custom Slurm tools
Jupyterhub_moss
⭐
13
Jupyterhub MOdular Slurm Spawner
Awflow
⭐
13
Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal computer!
Fseval
⭐
13
Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀
Clusterjob
⭐
13
Manage traditional HPC cluster workflows in Python
Metagenomics_workflows
⭐
13
Workflows for metagenomic sequence data processing and analysis.
Slurmscale
⭐
12
An external library for delivering Slurm Elastic Computing.
Phylotoast
⭐
12
Tools for phylogenetic data analysis including visualization and cluster-computing support.
Remote_ikernel
⭐
12
Benchbuild
⭐
11
Empirical-Research Toolkit
Pipelines
⭐
11
Slurm Charms
⭐
11
Repository containing the slurm operator charms
Tensorflow_slurm_manager
⭐
11
working on a cluster manager for TF
Job Maker
⭐
11
a static web application for generating job submissions scripts for a SLURM cluster
Autochem
⭐
11
Automation of computational chemistry tasks using GAMESS, Orca, PSI4 and Gaussian. Gamess tasks emphasise the use of FMO calculations.
Bert Ner Cmv
⭐
10
Related Searches
Python Django (28,897)
Python Machine Learning (20,195)
Python Flask (17,643)
Python Pytorch (14,996)
Python Dataset (14,792)
Python Tensorflow (14,267)
Python Docker (13,758)
Python Command Line (13,351)
Python Deep Learning (13,095)
Python Jupyter Notebook (12,976)
1-100 of 166 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.