Skip to content

Qovery/Replibyte

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

replibyte logo

Seed Your Development Database With Real Data ⚡️

Replibyte is a blazingly fast tool to seed your databases with your production data while keeping sensitive data safe 🔥

MIT License stable badge stable badge Build and Tests Discord

ROSS Index - Fastest Growing Open-Source Startups in Q3 2022 | Runa Capital

Prerequisites

  • MacOSX / Linux / Windows
  • Nothing more! Replibyte is stateless and does not require anything special.

Usage

Create a dump

replibyte -c conf.yaml dump create

List all dumps

replibyte -c conf.yaml dump list type name size when compressed encrypted PostgreSQL dump-1647706359405 154MB Yesterday at 03:00 am true true PostgreSQL dump-1647731334517 152MB 2 days ago at 03:00 am true true PostgreSQL dump-1647734369306 149MB 3 days ago at 03:00 am true true

Restore the latest dump in a local container

replibyte -c conf.yaml dump restore local -v latest -i postgres -p 5432

Restore the latest dump in a remote database

replibyte -c conf.yaml dump restore remote -v latest

Features

  • Support data dump and restore for PostgreSQL, MySQL and MongoDB
  • Analyze your data schema 🔎
  • Replace sensitive data with fake data
  • Works on large database (> 10GB)
  • Database Subsetting: Scale down a production database to a more reasonable size 🔥
  • Start a local database with the production data in a single command 🔥
  • On-the-fly data (de)compression (Zlib)
  • On-the-fly data de/encryption (AES-256)
  • Fully stateless (no server, no daemon) and lightweight binary 🍃
  • Use custom transformers

Here are the features we plan to support

  • Auto-detect and version database schema change
  • Auto-detect sensitive fields
  • Auto-clean backed up data

Getting Started

  1. How Replibyte works
  2. Initial setup:
    1. Install
    2. Configure
  3. Step-by-step guides:
    1. Create a dump
    2. Restore a dump
    3. Subset a dump
    4. Delete a dump
    5. Deploy Replibyte
      1. Container
      2. Qovery

Demo

What is RepliByte

Contributing

Check here.

Thanks

Thanks to all people sharing their ideas to make Replibyte better. We do appreciate it. I would also thank AirByte, a great product and a trustworthy source of inspiration for this project.


Replibyte is initiated and maintained by Qovery.