replibyte logo

Seed Your Development Database With Real Data

Replibyte is a blazingly fast tool to seed your databases with your production data while keeping sensitive data safe

Prerequisites

MacOSX / Linux / Windows
Nothing more! Replibyte is stateless and does not require anything special.

Usage

Create a dump

replibyte -c conf.yaml dump create

List all dumps

replibyte -c conf.yaml dump list

type          name                  size    when                    compressed  encrypted
PostgreSQL    dump-1647706359405    154MB   Yesterday at 03:00 am   true        true
PostgreSQL    dump-1647731334517    152MB   2 days ago at 03:00 am  true        true
PostgreSQL    dump-1647734369306    149MB   3 days ago at 03:00 am  true        true

Restore the latest dump in a local container

replibyte -c conf.yaml dump restore local -v latest -i postgres -p 5432

Restore the latest dump in a remote database

replibyte -c conf.yaml dump restore remote -v latest

Features

[x] Support data dump and restore for PostgreSQL, MySQL and MongoDB
[x] Analyze your data schema
[x] Replace sensitive data with fake data
[x] Works on large database (> 10GB)
[x] Database Subsetting: Scale down a production database to a more reasonable size
[x] Start a local database with the production data in a single command
[x] On-the-fly data (de)compression (Zlib)
[x] On-the-fly data de/encryption (AES-256)
[x] Fully stateless (no server, no daemon) and lightweight binary
[x] Use custom transformers

Here are the features we plan to support

[ ] Auto-detect and version database schema change
[ ] Auto-detect sensitive fields
[ ] Auto-clean backed up data

Getting Started

How Replibyte works
Initial setup:
1. Install
2. Configure
Step-by-step guides:
1. Create a dump
2. Restore a dump
3. Subset a dump
4. Delete a dump
5. Deploy Replibyte
  1. Container
  2. Qovery

Demo

Contributing

Check here.

Thanks

Thanks to all people sharing their ideas to make Replibyte better. We do appreciate it. I would also thank AirByte, a great product and a trustworthy source of inspiration for this project.

Replibyte is initiated and maintained by Qovery.

Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Developer Handbook	5,106			a month ago			6	mit
An opinionated guide on how to become a professional Web/Mobile App Developer.
Encore	3,755			a day ago	40	September 21, 2022	40	mpl-2.0	Go
Encore is the end-to-end Backend Development Platform that lets you escape cloud complexity.
Replibyte	3,512			3 months ago			82	gpl-3.0	Rust
Seed your development database with real data ⚡️
Data Science Best Resources	2,466			5 days ago			5	mit
Carefully curated resource links for data science in one place
Userbase	2,185	1	10	3 months ago	45	February 09, 2021	59	mit	JavaScript
Create secure and private web apps using only static JavaScript, HTML, and CSS.
Mimic Code	1,952			24 days ago	12	June 18, 2020	161	mit	Jupyter Notebook
MIMIC Code Repository: Code shared by the research community for the MIMIC family of databases
Terraboard	1,712			3 months ago	10	April 19, 2021	11	apache-2.0	Go
:earth_africa: :clipboard: A web dashboard to inspect Terraform States
Learn Devops	1,092			8 days ago			1		HCL
I am using this repository to document my devops journey. I follow the process of learning everything by tasks. Every task has an associated objective that encompasses an underlying concept. Concepts including CloudProviders, Containers, ContainersOrchestration, Databases, InfrastructureAsCode, Interview, VersionControl etc in progress
Inquery	1,091			a month ago			5	other	Go
Superpowers for PostgreSQL
Terraform Aws Rds	748			4 days ago			5	apache-2.0	HCL
Terraform module which creates RDS resources on AWS 🇺🇦