Awesome Open Source

Programming Languages

Search results for hpc slurm

87 search results found

Nextflow ⭐ 2,447

A DSL for data-driven computational pipelines

OpenHPC Integration, Packaging, and Test Repo

Pyslurm ⭐ 449

Python Interface to Slurm

Slurm_tools ⭐ 350

My tools for the Slurm HPC workload manager

Elasticluster ⭐ 334

Create clusters of VMs on the cloud and configure them with Ansible.

Batch Shipyard ⭐ 270

Simplify HPC and Batch workloads on Azure

Slurm Docker Cluster ⭐ 241

A Slurm cluster using docker-compose

Dask Jobqueue ⭐ 229

Deploy Dask on job schedulers like PBS, SLURM, and SGE

Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for Lustre, Slurm, Moab, Torque. LSF, Flux, and more.

An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.

Hpc Now ⭐ 168

A Cross-Platform, Multi-Cloud High-Performance Computing Platform

Batchtools ⭐ 158

Tools for computation on batch systems

A collection of various resources, examples, and executables for the general NREL HPC user community's benefit. Use the following website for accessing documentation.

Future.batchtools ⭐ 83

🚀 R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools

Docker Centos7 Slurm ⭐ 81

Slurm Docker Container on CentOS 7

Coldfront ⭐ 79

HPC Resource Allocation System

Slurm In Docker ⭐ 78

Slurm in Docker - Exploring Slurm using CentOS 7 based Docker images

Wlm Operator ⭐ 75

Singularity implementation of k8s operator for interacting with SLURM.

Parallel_programming_course ⭐ 67

Parallel-Programming

Fgci Ansible ⭐ 54

🔬 Collection of the Finnish Grid and Cloud Infrastructure Ansible playbooks

slurmR: A Lightweight Wrapper for Slurm

Cyclecloud Slurm ⭐ 45

Azure CycleCloud project to enable users to create, configure, and use Slurm HPC clusters.

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

Slurm Drmaa ⭐ 40

DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm

COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.

A toolkit featured artificial intelligence × ab initio for computational chemistry research.

Dpdispatcher ⭐ 36

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

Ansible Simple Slurm Cluster ⭐ 34

A very simple HPC-style cluster with SLURM

Goslmailer ⭐ 33

GoSlurmMailer - drop in replacement for default slurm MailProg. Delivers slurm job messages to various destinations.

Ansible Slurm Appliance ⭐ 33

A Slurm-based HPC workload management environment, driven by Ansible.

Awesome Aws Research ⭐ 30

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources for Academic Researchers new to AWS

Teaching Examples ⭐ 30

Examples for use in teaching HPSC workflows, from how to successfully parallelize code, to how to submit that code on an HPC system.

Aws Parallelcluster Monitoring ⭐ 27

Monitoring Dashboard for AWS ParallelCluster

Covalent Slurm Plugin ⭐ 26

Executor plugin interfacing Covalent with Slurm

Hpc Submission Scripts ⭐ 26

Example job submission scripts for HPC systems (PBS and SLURM)

Slurmcommander ⭐ 23

Qhub Hpc ⭐ 22

Scripts to facilitate parallel InSAR processing and analysis of Sentinel-1 time series on HPC clusters based on GMTSAR and Slurm.

Assemblycomparator2 ⭐ 20

🦠📇 Compare prokaryotic genomic assemblies

Lsf Handbook ⭐ 19

IBM LSF manual translation and practical experience

Sparkhpc ⭐ 19

launching and controlling spark on hpc clusters

Uabrc.github.io ⭐ 18

UAB Research Computing Documentation

BAO Model Fitting Made Easy

Cluster Utils ⭐ 17

Collection of utilities / helper scripts to make life easier on our HPC clusters.

Alphafold_singularity ⭐ 17

Singularity recipe for AlphaFold

Shine Cluster ⭐ 15

Simple High performance Infrastructure for Neural network Experiments

Longbow is a tool for automating simulations on a remote HPC machine. Longbow is designed to mimic the normal way an application is run locally but allows simulations to be sent to powerful machines.

Slurmtools ⭐ 13

Custom Slurm tools

Launcher Scripts ⭐ 13

A set of launcher scripts to be used with OAR for running jobs on the UL HPC platform

Reproducible research and reusable acyclic workflows in Python. Execute code on HPC systems as if you executed them on your personal computer!

Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.

Clusterjob ⭐ 13

Manage traditional HPC cluster workflows in Python

Phylotoast ⭐ 12

Tools for phylogenetic data analysis including visualization and cluster-computing support.

Hpc_r_workshop ⭐ 11

Aws Parallelcluster Post Install Scripts ⭐ 11

Scripts to customize AWS ParallelCluster

Variant Calling Pipeline ⭐ 11

HPC based pipelines for variant calling using GATK

Sarchive ⭐ 11

Slurm job script archival

A simple Redis-backed distributed virtual filesystem for co-execution of HPC and data analytics workloads

Guppy_on_slurm ⭐ 10

Splitting and accelerating the Oxford Nanopore basecaller guppy using CPU with the SLURM job scheduler

Ostack Hpc ⭐ 10

Enables HPC Environment in an OpenStack Cloud

Spark On Slurm ⭐ 10

Unleash the true power of scheduling

Hpc Collab ⭐ 9

This project provides provisioned HPC cluster models using underlying virtualization mechanisms.

Pangeo Hpc Singularity ⭐ 8

Scripts to run dask and jupyter lab on Singularity using the pangeo-notebook image

Ansible Hpc ⭐ 8

Ansible modules for HPC clusters

Hpc Infrastructure Scripts ⭐ 8

Scripts used in ILRI's research computing infrastructure

Slurm_jupyter_kernel ⭐ 8

Manage (create, list, modify and delete) and starting jupyter kernels using sbatch

Future.batchjobs ⭐ 8

🚀 R package: future.BatchJobs: A Future API for Parallel and Distributed Processing using BatchJobs [Intentionally archived on CRAN on 2021-01-08]

Dl_hpc_starter_pack ⭐ 7

pip install the deep learning & HPC starter pack to begin your project.

Future.clustermq ⭐ 7

🚀 R package future.clustermq: A Future API for Parallel Processing using 'clustermq'

Great_lakes_slurm ⭐ 7

Using the Great Lakes cluster and batch computing with SLURM

Tigress Scripts ⭐ 7

[Not Current] Setup and Example scripts for R-based HPC at Princeton University

Hpc Savio Xsede ⭐ 7

Multicore and multi-node parallel R computation via SLURM on the Savio cluster at UC Berkeley, plus XSEDE

CCQ is a meta-scheduler to link disparate HPC environments with the Job as the payload of work

Cloudify Hpc Plugin ⭐ 7

Plugin to allow Cloudify to deploy and orchestrate HPC resources

Slurm Qog ⭐ 7

Perl script to generate "quality-of-guess" feedback for users about their requested Slurm walltimes.

Slurm Tools ⭐ 7

Slurm tools used on CARC HPC clusters

A python package that allows easy sbatch job script creation and submissions on hpc clusters, directly from python.

Mycluster ⭐ 7

Utilities to support interacting with multiple HPC clusters

Aws Mpi Benchmark ⭐ 6

MPI Benchmark on AWS HPC cluster

Slurmdocker ⭐ 6

A Slurm Docker image for use on AWS and/or locally

Scheduling Connector For Hadoop ⭐ 6

HPC Adapter for Mapreduce/Yarn(HAM)

Tum Dlr Automl For Eo ⭐ 5

Neural Architecture Search Pipeline on HPC for Earth Observation Data

A Python 3.5+ library that takes care of several tedious aspects of working with big data on an HPC cluster.

Tool for managing HPC workloads

Monitoring Tool for HPC metrics from batch scheduler and BMC resources

Rpcdataloader ⭐ 5

A variant of the PyTorch Dataloader using remote workers.

Related Searches

Python Hpc (493)

Python Slurm (365)

1-87 of 87 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.