The Top 51 Reproducibility Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

reproducibility x

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 51 Reproducibility Open Source Projects

Categories > Science > Reproducibility

🦉Data Version Control | Git for Data & Models

Sacred ⭐ 3,428

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Catalyst ⭐ 2,547

Accelerated deep learning R&D

Vps Comparison ⭐ 1,359

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

Drake ⭐ 1,310

An R-focused pipeline toolkit for reproducibility and high-performance computing

Garage ⭐ 1,151

A toolkit for reproducible reinforcement learning research.

Evalai ⭐ 1,115

☁️ 🚀 📊 📈 Evaluating state of the art in AI

Snakemake ⭐ 954

This is the development home of the workflow management system Snakemake. For general information, see

Recsys2019_deeplearning_evaluation ⭐ 800

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

Labnotebook ⭐ 527

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Rrtools ⭐ 512

rrtools: Tools for Writing Reproducible Research in R

Gtsummary ⭐ 495

Presentation-Ready Data Summary and Analytic Result Tables

Mimicry ⭐ 475

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

Workflow Description Language - Specification and Implementations

Collective Knowledge framework (CK) helps to organize black-box research software as a database of reusable components and micro-services with common APIs, automation actions and extensible meta descriptions. See real-world use cases from Arm, General Motors, ACM, Raspberry Pi foundation, MLPerf and other great partners:

Open Solution Home Credit ⭐ 400

Open solution to the Home Credit Default Risk challenge 🏡

Targets ⭐ 370

Function-oriented Make-like declarative workflows for R

Open source production model management tool for data scientists

Mach Nix ⭐ 250

Create highly reproducible python environments

Jupyterwith ⭐ 246

declarative and reproducible Jupyter environments - powered by Nix

Reprozip ⭐ 238

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

Container-native task automation engine.

Lightning Hydra Template ⭐ 222

PyTorch Lightning + Hydra. A very general, feature-rich template for rapid and scalable ML experimentation with best practices. ⚡🔥⚡

Nn Template ⭐ 208

Generic template to bootstrap your PyTorch project with PyTorch Lightning, Hydra, W&B, DVC, and Streamlit.

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

Anaconda Project ⭐ 157

Tool for encapsulating, running, and reproducing data science projects

The Renku Project provides a platform and tools for reproducible and collaborative data analysis.

Accelerator ⭐ 139

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

Dna Seq Gatk Variant Calling ⭐ 139

This Snakemake pipeline implements the GATK best-practices workflow

Datapackager ⭐ 129

An R package to enable reproducible data processing, packaging and sharing.

Batchtools ⭐ 128

Tools for computation on batch systems

Rl Medical ⭐ 127

Deep Reinforcement Learning (DRL) agents applied to medical images

Make Novice ⭐ 126

Automation and Make

Awesome Reproducible Research ⭐ 124

A curated list of reproducible research case studies, projects, tutorials, and media

Reproducibility Guide ⭐ 119

project page for creating a guide to reproducible research

Lightweight, Python library for fast and reproducible experimentation 🔬

Starters ⭐ 114

R Package 📦 for initializing projects for various R activities 🔩

This is our implementation of ENMF: Efficient Neural Matrix Factorization (TOIS. 38, 2020). This also provides a fair evaluation of existing state-of-the-art recommendation models.

Reproducible Research ⭐ 96

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

Vistrails ⭐ 94

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

Scalac Profiling ⭐ 92

Implementation of SCP-010.

Manage large and heterogeneous data spaces on the file system.

Reproduce Stock Market Direction Random Forests ⭐ 68

Reproduce research from paper "Predicting the direction of stock market prices using random forest"

Drake Examples ⭐ 58

Example workflows for the drake R package

Tensorhub ⭐ 50

TensorHub is a library built on top of TensorFlow 2.0 to provide simple, modular and repeatable abstractions to accelerate deep learning research.

Open Solution Value Prediction ⭐ 34

Open solution to the Santander Value Prediction Challenge 🐠

Say the magic word 😸

Segmentation ⭐ 27

Catalyst.Segmentation

Steppy Toolkit ⭐ 21

Curated set of transformers that make your work with steppy faster and more effective 🔭

Rr Version Control ⭐ 7

Reproducible Science Curriculum Lesson for Version Control

1-51 of 51 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210