chudry / ptubes

Ptubes is a database disaster recovery product based on the PITR (Point In Time Recovery) method, which can be used to restore the entire database to a specific point in time to help users improve the reliability and security of the database

Introduction

---

---

Ptubes is a database disaster recovery product based on PITR (Point In Time Recovery), which can be used to restore the entire database to a specific point in time to help users improve the reliability and security of the database. The product consists of three core components, Reader, Storage and SDK. It provides functions such as safe backup and efficient distribution of database change events. Typical scenarios are as follows:

• data backup
• Data playback
• Data Recovery
• Event driven
• The database is more active

Quick Start

Prerequisite

• 64bit JDK 1.8+

• Maven 3.2.x

Run Reader

1.mysql preparation
Ptubes synchronization data requires mysql to support Binlog ROW mode in advance, users need to modify the binlog mode in advance

[mysqld]

log-bin=mysql-bin # Open binlog

binlog-format=ROW # Modify to ROW mode

2.Start Reader
2.1.Download the compressed package
ptubes-reader-server.tar.gz

2.2.Unzip to any directory

mkdir /user/ptubes
tar zxvf ptubes-reader-server.tar.gz -C /tmp/ptubes

After decompression, you can see the directory structure

drwxr-xr-x   4 yangmouren  staff   128  2 17 16:47 bin
drwxr-xr-x   5 yangmouren  staff   160  2 17 16:54 conf
drwxr-xr-x  63 yangmouren  staff  2016  2 17 17:00 lib

2.3.Modify related configuration information In the conf directory, modify a reader.conf and fill in the configuration

ptubes.server.tasks=demoR1,demoR2 //Task name, each task needs to have configuration information of the corresponding file, separated by commas

The program will continue to read the ReaderTask related configuration according to the parameters of ptubes.server.tasks. Take the above picture as an example, the program will automatically search for demoR1.properties and demoR2.properties from the current directory, and we will create corresponding files respectively (as shown in the following figure)

ptubes.reader.mysql.host= //mysql host address
ptubes.reader.mysql.port= //mysql port
ptubes.reader.mysql.user= //mysql username
ptubes.reader.mysql.passwd= //mysql password

Then run the program to start the ptubes exploration journey.

2.4.Start the service

sh bin/start.sh

2.5.View service log

tail -f logs/reader.log

2.6.Shut down the service

sh bin/stop.sh

Start the SDK

SDK start

more configuration

configuration document

Documentation

• 1.Home
• 2.Architecture-design
  • 2.1.Overall Architecture and Deployment
  • 2.2.Module description
  • 2.3.implementation details
• 3.QuickStart
  • 3.1.mysql-preparation
  • 3.2.Start Reader
• 4.Client User Guide
  • 4.1.Start mode one
  • 4.2.Start mode two
  • 4.3.Start mode three
• 5.Configuration usage guide
  • 5.1.Reader Configuration
  • 5.2.SDK Configuration
• 6.Local Debugging Guide

License

Apache License, Version 2.0 Copyright (C) Apache Software Foundation

issues

Ptubes ISSUES