The Top 46 Reproducibility Open Source Projects

Awesome Open Source

Awesome Open Source

Combined Topics

reproducibility x

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210

The Top 46 Reproducibility Open Source Projects

Categories > Science > Reproducibility

🦉Data Version Control | Git for Data & Models

Sacred ⭐ 3,329

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Catalyst ⭐ 2,449

Accelerated deep learning R&D

Vps Comparison ⭐ 1,355

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

Drake ⭐ 1,299

An R-focused pipeline toolkit for reproducibility and high-performance computing

Garage ⭐ 1,083

A toolkit for reproducible reinforcement learning research.

Evalai ⭐ 1,071

☁️ 🚀 📊 📈 Evaluating state of the art in AI

Snakemake ⭐ 870

This is the development home of the workflow management system Snakemake. For general information, see

Recsys2019_deeplearning_evaluation ⭐ 774

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

Labnotebook ⭐ 525

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Rrtools ⭐ 503

rrtools: Tools for Writing Reproducible Research in R

Mimicry ⭐ 453

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

Gtsummary ⭐ 441

Presentation-Ready Data Summary and Analytic Result Tables

Workflow Description Language - Specification and Implementations

Open Solution Home Credit ⭐ 397

Open solution to the Home Credit Default Risk challenge 🏡

Collective Knowledge framework (CK) helps to organize black-box research software as a database of reusable components and micro-services with common APIs, automation actions and extensible meta descriptions. See real-world use cases from Arm, General Motors, ACM, Raspberry Pi foundation and others:

Open source production model management tool for data scientists

Targets ⭐ 267

Function-oriented Make-like declarative workflows for R

Jupyterwith ⭐ 233

declarative and reproducible Jupyter environments - powered by Nix

Reprozip ⭐ 229

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

Container-native task automation engine.

Mach Nix ⭐ 212

Create highly reproducible python environments

PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.

Anaconda Project ⭐ 151

Tool for encapsulating, running, and reproducing data science projects

The Renku Project provides a platform and tools for reproducible and collaborative data analysis.

Accelerator ⭐ 137

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

Dna Seq Gatk Variant Calling ⭐ 130

This Snakemake pipeline implements the GATK best-practices workflow

Batchtools ⭐ 125

Tools for computation on batch systems

Datapackager ⭐ 124

An R package to enable reproducible data processing, packaging and sharing.

Rl Medical ⭐ 121

Deep Reinforcement Learning (DRL) agents applied to medical images

Make Novice ⭐ 120

Automation and Make

Lightweight, Python library for fast and reproducible experimentation 🔬

Reproducibility Guide ⭐ 115

project page for creating a guide to reproducible research

Starters ⭐ 111

R Package 📦 for initializing projects for various R activities 🔩

Awesome Reproducible Research ⭐ 100

A curated list of reproducible research case studies, projects, tutorials, and media

Reproducible Research ⭐ 95

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

Vistrails ⭐ 94

VisTrails is an open-source data analysis and visualization tool. It provides a comprehensive provenance infrastructure that maintains detailed history information about the steps followed and data derived in the course of an exploratory task: VisTrails maintains provenance of data products, of the computational processes that derive these products and their executions.

Scalac Profiling ⭐ 90

Implementation of SCP-010.

Reproduce Stock Market Direction Random Forests ⭐ 67

Reproduce research from paper "Predicting the direction of stock market prices using random forest"

Drake Examples ⭐ 57

Example workflows for the drake R package

Tensorhub ⭐ 48

TensorHub is a library built on top of TensorFlow 2.0 to provide simple, modular and repeatable abstractions to accelerate deep learning research.

Open Solution Value Prediction ⭐ 34

Open solution to the Santander Value Prediction Challenge 🐠

Say the magic word 😸

Segmentation ⭐ 27

Catalyst.Segmentation

Steppy Toolkit ⭐ 21

Curated set of transformers that make your work with steppy faster and more effective 🔭

1-46 of 46 projects

Advertising 📦 10

Application Programming Interfaces 📦 124

Applications 📦 192

Artificial Intelligence 📦 78

Blockchain 📦 73

Build Tools 📦 113

Cloud Computing 📦 80

Code Quality 📦 28

Collaboration 📦 32

Command Line Interface 📦 49

Community 📦 83

Companies 📦 60

Compilers 📦 63

Computer Science 📦 80

Configuration Management 📦 42

Content Management 📦 175

Control Flow 📦 213

Data Formats 📦 78

Data Processing 📦 276

Data Storage 📦 135

Economics 📦 64

Frameworks 📦 215

Graphics 📦 110

Hardware 📦 152

Integrated Development Environments 📦 49

Learning Resources 📦 166

Libraries 📦 129

Lists Of Projects 📦 22

Machine Learning 📦 347

Mapping 📦 64

Marketing 📦 15

Mathematics 📦 55

Messaging 📦 98

Networking 📦 315

Operating Systems 📦 89

Operations 📦 121

Package Managers 📦 55

Programming Languages 📦 245

Runtime Environments 📦 100

Science 📦 42

Security 📦 396

Social Media 📦 27

Software Architecture 📦 72

Software Development 📦 72

Software Performance 📦 58

Software Quality 📦 133

Text Editors 📦 49

Text Processing 📦 136

User Interface 📦 330

User Interface Components 📦 514

Version Control 📦 30

Virtualization 📦 71

Web Browsers 📦 42

Web Servers 📦 26

Web User Interface 📦 210