The Top 57 Reproducibility Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

reproducibility x

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 57 Reproducibility Open Source Projects

Categories > Science > Reproducibility

🦉Data Version Control | Git for Data & Models | ML Experiments Management

Sacred ⭐ 3,536

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Catalyst ⭐ 2,680

Accelerated deep learning R&D

Vps Comparison ⭐ 1,367

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

Drake ⭐ 1,319

An R-focused pipeline toolkit for reproducibility and high-performance computing

Garage ⭐ 1,239

A toolkit for reproducible reinforcement learning research.

Evalai ⭐ 1,218

☁️ 🚀 📊 📈 Evaluating state of the art in AI

Mlreef ⭐ 1,149

The collaborative workspace for Machine Learning

Snakemake ⭐ 1,041

This is the development home of the workflow management system Snakemake. For general information, see

Recsys2019_deeplearning_evaluation ⭐ 831

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

Rrtools ⭐ 536

rrtools: Tools for Writing Reproducible Research in R

Labnotebook ⭐ 527

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Gtsummary ⭐ 527

Presentation-Ready Data Summary and Analytic Result Tables

Mimicry ⭐ 485

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

Workflow Description Language - Specification and Implementations

Targets ⭐ 442

Function-oriented Make-like declarative workflows for R

Lightning Hydra Template ⭐ 435

PyTorch Lightning + Hydra. A very general, feature-rich template for rapid and scalable ML experimentation with best practices. ⚡🔥⚡

Collective Knowledge framework (CK) helps to organize software projects as a database of reusable components, automation recipes and portable workflows with common APIs and extensible meta descriptions based on FAIR principles. See the real-world use cases to support reproducible MLSys R&D, enable portable MLOps and automate ML/SW/HW co-design:

Open Solution Home Credit ⭐ 398

Open solution to the Home Credit Default Risk challenge 🏡

Open source production model management tool for data scientists

Mach Nix ⭐ 325

Create highly reproducible python environments

Jupyterwith ⭐ 275

declarative and reproducible Jupyter environments - powered by Nix

Torch Fidelity ⭐ 265

High-fidelity performance metrics for generative models in PyTorch

Nn Template ⭐ 261

Generic template to bootstrap your PyTorch project with PyTorch Lightning, Hydra, W&B, DVC, and Streamlit.

Reprozip ⭐ 243

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

Container-native task automation engine.

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

Rna Seq Star Deseq2 ⭐ 177

RNA-seq workflow using STAR and DESeq2

Anaconda Project ⭐ 161

Tool for encapsulating, running, and reproducing data science projects

The Renku Project provides a platform and tools for reproducible and collaborative data analysis.

Awesome Reproducible Research ⭐ 149

A curated list of reproducible research case studies, projects, tutorials, and media

Dna Seq Gatk Variant Calling ⭐ 144

This Snakemake pipeline implements the GATK best-practices workflow

Accelerator ⭐ 140

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

Like `go get` but for Go tools! CI Automating versioning of Go binaries in a nested, isolated Go modules.

Batchtools ⭐ 132

Tools for computation on batch systems

Datapackager ⭐ 130

An R package to enable reproducible data processing, packaging and sharing.

Rl Medical ⭐ 130

Deep Reinforcement Learning (DRL) agents applied to medical images

Make Novice ⭐ 128

Automation and Make

Reproducibility Guide ⭐ 119

project page for creating a guide to reproducible research

Lightweight, Python library for fast and reproducible experimentation 🔬

Starters ⭐ 115

R Package 📦 for initializing projects for various R activities 🔩

This is our implementation of ENMF: Efficient Neural Matrix Factorization (TOIS. 38, 2020). This also provides a fair evaluation of existing state-of-the-art recommendation models.

Bigscity Libtraffic ⭐ 105

LibTraffic: An Open Library for Traffic Prediction

Reproducible Research ⭐ 96

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

Vistrails ⭐ 95

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

Scalac Profiling ⭐ 91

Implementation of SCP-010.

Reproduce Stock Market Direction Random Forests ⭐ 72

Reproduce research from paper "Predicting the direction of stock market prices using random forest"

Manage large and heterogeneous data spaces on the file system.

Drake Examples ⭐ 58

Example workflows for the drake R package

Tensorhub ⭐ 49

TensorHub is a library built on top of TensorFlow 2.0 to provide simple, modular and repeatable abstractions to accelerate deep learning research.

Dna Seq Varlociraptor ⭐ 40

A Snakemake workflow for calling small and structural variants under any kind of scenario (tumor/normal, tumor/normal/relapse, germline, pedigree, populations) via the unified statistical model of Varlociraptor.

Open Solution Value Prediction ⭐ 34

Open solution to the Santander Value Prediction Challenge 🐠

Say the magic word 😸

Segmentation ⭐ 27

Catalyst.Segmentation

Steppy Toolkit ⭐ 20

Curated set of transformers that make your work with steppy faster and more effective 🔭

Rr Version Control ⭐ 7

Reproducible Science Curriculum Lesson for Version Control

1-57 of 57 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210