Online MySQL Backups with Percona XtraBackup
1 like1,263 views
Percona XtraBackup is a free, open source, complete online backup solution for all versions of Percona Server, MySQL® and MariaDB®. Percona XtraBackup provides: * Fast and reliable backups * Uninterrupted transaction processing during backups * Savings on disk space and network bandwidth with better compression * Automatic backup verification * Higher uptime due to faster restore time This talk will discuss the various different features of Percona XtraBackup, including: * Full & Incremental Backups * Compression, Streaming & Encryption of Backups * Backing Up To The Cloud (Swift). * Percona XtraDB Cluster / Galera Cluster. * Percona Server Specific features
![(Data) Backup Process - 1. Backup
#xtrabackup--backup--target-dir=/data/backups/
16100122:16:49ConnectingtoMySQLserverhost:localhost,user:root,password:not
Usingserverversion5.7.14-8-log
xtrabackupversion2.4.4basedonMySQLserver5.7.13Linux(x86_64)(revisionid
xtrabackup:usesposix_fadvise().
...
InnoDB:Numberofpools:1
16100122:16:49>>logscannedupto(5147619414)
xtrabackup:Generatingalistoftablespaces
InnoDB:AllocatedtablespaceID2formysql/plugin,oldmaximumwas0
16100122:16:50[01]Copying./ibdata1to/data/backups/ibdata1
16100122:16:50[01]Copying./mysql/plugin.ibdto/data/backups/mysql/plugin.ibd
16100122:16:50[01]Copying./mysql/servers.ibdto/data/backups/mysql/servers.ibd
16100122:16:50[01]Copying./mysql/help_topic.ibdto/data/backups/mysql/help_topic.i
...
16100122:17:13[01]Copying./imdb/users.ibdto/data/backups/imdb/users.ibd
16100122:17:13>>logscannedupto(5147619414)
16100122:17:14ExecutingFLUSHNO_WRITE_TO_BINLOGTABLES...
16100122:17:14ExecutingFLUSHTABLESWITHREADLOCK...
14 / 42](https://image.slidesharecdn.com/onlinebackupswithperconaxtrabackup-161013130345/85/Online-MySQL-Backups-with-Percona-XtraBackup-14-320.jpg)
![(Data) Backup Process - 1. Backup (2)
16100122:17:14Startingtobackupnon-InnoDBtablesand les
16100122:17:14[01]Copying./mysql/db.optto/data/backups/mysql/db.opt
16100122:17:14[01]Copying./mysql/db.frmto/data/backups/mysql/db.frm
16100122:17:14[01]Copying./mysql/db.MYIto/data/backups/mysql/db.MYI
16100122:17:14[01]Copying./mysql/db.MYDto/data/backups/mysql/db.MYD
16100122:17:17[01]Copying./imdb/users.frmto/data/backups/imdb/users.frm
16100122:17:17Finishedbackingupnon-InnoDBtablesand les
16100122:17:17ExecutingFLUSHNO_WRITE_TO_BINLOGENGINELOGS...
xtrabackup:Thelatestcheckpoint(forincremental):'5147619454'
xtrabackup:Stoppinglogcopyingthread.
.16100122:17:17>>logscannedupto(5147619463)
16100122:17:17ExecutingUNLOCKTABLES
16100122:17:17Alltablesunlocked
16100122:17:17[00]Copyingib_buffer_poolto/data/backups/ib_buffer_pool
16100122:17:17[00] ...done
16100122:17:17Backupcreatedindirectory'/data/backups/'
16100122:17:17[00]Writingbackup-my.cnf
16100122:17:17[00] ...done
16100122:17:17[00]Writingxtrabackup_info
16100122:17:17[00] ...done
xtrabackup:Transactionlogoflsn(5147619405)to(5147619463)wascopied.
16100122:17:18completedOK!
15 / 42](https://image.slidesharecdn.com/onlinebackupswithperconaxtrabackup-161013130345/85/Online-MySQL-Backups-with-Percona-XtraBackup-15-320.jpg)
Ad
More Related Content
What's hot (20)
Viewers also liked (20)
Ad
Similar to Online MySQL Backups with Percona XtraBackup (20)
Ad
More from Kenny Gryp (13)
Recently uploaded (20)
Online MySQL Backups with Percona XtraBackup
- 1. Online Backups with Percona Live Amsterdam - October 2016 1 / 42
- 2. Kenny Gryp @gryp MySQL Practice Manager 2 / 42
- 3. Agenda What is Percona XtraBackup Backup Process Restore Process Incremental Compression, Streaming, Encryption Cloud Backups - α Percona Server Specific Features 3 / 42
- 4. 4 / 42 What is
- 5. What is Backups for: 5 / 42
- 6. What is Backups for: 6 / 42
- 7. Online (Non Blocking) InnoDB Backups Physical Datafiles Copied What is https://www.percona.com/software/mysql-database/percona-xtrabackup 7 / 42
- 8. Online (Non Blocking) InnoDB Backups Physical Datafiles Copied Less Impact on Production Faster Restore Time Than Logical Backups What is https://www.percona.com/software/mysql-database/percona-xtrabackup 8 / 42
- 9. Online (Non Blocking) InnoDB Backups Physical Datafiles Copied Less Impact on Production Faster Restore Time Than Logical Backups What is https://www.percona.com/software/mysql-database/percona-xtrabackup Open Source Blocking Support MyISAM... Incremental/Delta Compression/Encryption Cloud Backup 9 / 42
- 10. 10 / 42 (Data) Backup Process
- 11. (Data) Backup Process - 1. Backup Backup .ibdfiles while in use /var/lib/mysql/ibdata1 /var/lib/mysql/imdb/aka_name.ibd /var/lib/mysql/imdb/aka_title.ibd ... 11 / 42
- 12. (Data) Backup Process - 1. Backup Backup .ibdfiles while in use /var/lib/mysql/ibdata1 /var/lib/mysql/imdb/aka_name.ibd /var/lib/mysql/imdb/aka_title.ibd ... track changes through trx logs /var/lib/mysql/ib_log le0 /var/lib/mysql/ib_log le1 12 / 42
- 13. (Data) Backup Process - 2. Prepare Apply changes from trx logs onto backupped .ibdfiles. 13 / 42
- 14. (Data) Backup Process - 1. Backup #xtrabackup--backup--target-dir=/data/backups/ 16100122:16:49ConnectingtoMySQLserverhost:localhost,user:root,password:not Usingserverversion5.7.14-8-log xtrabackupversion2.4.4basedonMySQLserver5.7.13Linux(x86_64)(revisionid xtrabackup:usesposix_fadvise(). ... InnoDB:Numberofpools:1 16100122:16:49>>logscannedupto(5147619414) xtrabackup:Generatingalistoftablespaces InnoDB:AllocatedtablespaceID2formysql/plugin,oldmaximumwas0 16100122:16:50[01]Copying./ibdata1to/data/backups/ibdata1 16100122:16:50[01]Copying./mysql/plugin.ibdto/data/backups/mysql/plugin.ibd 16100122:16:50[01]Copying./mysql/servers.ibdto/data/backups/mysql/servers.ibd 16100122:16:50[01]Copying./mysql/help_topic.ibdto/data/backups/mysql/help_topic.i ... 16100122:17:13[01]Copying./imdb/users.ibdto/data/backups/imdb/users.ibd 16100122:17:13>>logscannedupto(5147619414) 16100122:17:14ExecutingFLUSHNO_WRITE_TO_BINLOGTABLES... 16100122:17:14ExecutingFLUSHTABLESWITHREADLOCK... 14 / 42
- 15. (Data) Backup Process - 1. Backup (2) 16100122:17:14Startingtobackupnon-InnoDBtablesand les 16100122:17:14[01]Copying./mysql/db.optto/data/backups/mysql/db.opt 16100122:17:14[01]Copying./mysql/db.frmto/data/backups/mysql/db.frm 16100122:17:14[01]Copying./mysql/db.MYIto/data/backups/mysql/db.MYI 16100122:17:14[01]Copying./mysql/db.MYDto/data/backups/mysql/db.MYD 16100122:17:17[01]Copying./imdb/users.frmto/data/backups/imdb/users.frm 16100122:17:17Finishedbackingupnon-InnoDBtablesand les 16100122:17:17ExecutingFLUSHNO_WRITE_TO_BINLOGENGINELOGS... xtrabackup:Thelatestcheckpoint(forincremental):'5147619454' xtrabackup:Stoppinglogcopyingthread. .16100122:17:17>>logscannedupto(5147619463) 16100122:17:17ExecutingUNLOCKTABLES 16100122:17:17Alltablesunlocked 16100122:17:17[00]Copyingib_buffer_poolto/data/backups/ib_buffer_pool 16100122:17:17[00] ...done 16100122:17:17Backupcreatedindirectory'/data/backups/' 16100122:17:17[00]Writingbackup-my.cnf 16100122:17:17[00] ...done 16100122:17:17[00]Writingxtrabackup_info 16100122:17:17[00] ...done xtrabackup:Transactionlogoflsn(5147619405)to(5147619463)wascopied. 16100122:17:18completedOK! 15 / 42
- 16. (Data) Backup Process - 2. Prepare (1) #xtrabackup--prepare--target-dir=/data/backups/ xtrabackupversion2.4.4basedonMySQLserver5.7.13Linux(x86_64)(revisionid:df58 xtrabackup:cdto/data/backups xtrabackup:Thistargetseemstobenotpreparedyet. ... xtrabackup:StartingInnoDBinstanceforrecovery. xtrabackup:Using104857600bytesforbufferpool(setby--use-memoryparameter) ... InnoDB:Logscanprogressedpastthecheckpointlsn5147619405 InnoDB:Doingrecovery:scanneduptologsequencenumber5147619463(0%) InnoDB:Doingrecovery:scanneduptologsequencenumber5147619463(0%) InnoDB:Databasewasnotshutdownnormally! InnoDB:Startingcrashrecovery. InnoDB:xtrabackup:LastMySQLbinlog leposition333, lenameperconaserver-bin.000007 ... InnoDB:96redorollbacksegment(s)found.1redorollbacksegment(s)areactive. InnoDB:32non-redorollbacksegment(s)areactive. InnoDB:Waitingforpurgetostart InnoDB:5.7.13started;logsequencenumber5147619463 InnoDB:xtrabackup:LastMySQLbinlog leposition333, lenameperconaserver-bin.00 xtrabackup:startingshutdownwithinnodb_fast_shutdown=1 InnoDB:FTSoptimizethreadexiting. InnoDB:Startingshutdown... InnoDB:Shutdowncompleted;logsequencenumber5147619482 16 / 42
- 17. (Data) Backup Process - 2. Prepare (2) ... InnoDB:Settinglog le./ib_log le101sizeto64MB InnoDB:Settinglog le./ib_log le1sizeto64MB InnoDB:Renaminglog le./ib_log le101to./ib_log le0 InnoDB:Newlog lescreated,LSN=5147619482 InnoDB:Highestsupported leformatisBarracuda. InnoDB:Logscanprogressedpastthecheckpointlsn5147619852 InnoDB:Doingrecovery:scanneduptologsequencenumber5147619861(0%) InnoDB:Doingrecovery:scanneduptologsequencenumber5147619861(0%) InnoDB:Databasewasnotshutdownnormally! InnoDB:Startingcrashrecovery. InnoDB:xtrabackup:LastMySQLbinlog leposition333, lenameperconaserver-bin ... InnoDB:96redorollbacksegment(s)found.1redorollbacksegment(s)areactive. InnoDB:32non-redorollbacksegment(s)areactive. InnoDB:Waitingforpurgetostart InnoDB:5.7.13started;logsequencenumber5147619861 xtrabackup:startingshutdownwithinnodb_fast_shutdown=1 InnoDB:FTSoptimizethreadexiting. InnoDB:Startingshutdown... InnoDB:Shutdowncompleted;logsequencenumber5147619880 16100122:30:05completedOK! 17 / 42
- 18. 18 / 42 Restore Process
- 19. Restore Process After preparation, the backup directory ==data directory 19 / 42
- 20. Restore Process After preparation, the backup directory ==data directory #cp-R/data/backup//var/lib/mysql #chown-Rmysql:mysql/var/lib/mysql #systemctlstartmysqld 20 / 42
- 21. 21 / 42 Incremental Backups
- 22. Incremental Backups 22 / 42
- 23. Incremental Backups Only Copy InnoDB Pages That Changed (still copies all non InnoDB Tables) 23 / 42
- 24. Pro: Smaller backup size Faster To Backup Incremental & Delta Incremental Backups Only Copy InnoDB Pages That Changed (still copies all non InnoDB Tables) 24 / 42
- 25. Pro: Smaller backup size Faster To Backup Incremental & Delta Con: Slower to restore than full On , all data is read Incremental Backups Only Copy InnoDB Pages That Changed (still copies all non InnoDB Tables) 25 / 42
- 26. Incremental Backups - Process 26 / 42
- 27. Incremental Backups - Process Take Incremental: #xtrabackup--backup --target-dir=/data/backups/inc/tuesday/ --incremental-basedir=/data/backups/full/sunday/ 27 / 42
- 28. Incremental Backups - Process Take Incremental: #xtrabackup--backup --target-dir=/data/backups/inc/tuesday/ --incremental-basedir=/data/backups/full/sunday/ Prepare Full #xtrabackup--prepare --apply-log-only --target-dir=/data/backups/mysql/ 28 / 42
- 29. Incremental Backups - Process Take Incremental: #xtrabackup--backup --target-dir=/data/backups/inc/tuesday/ --incremental-basedir=/data/backups/full/sunday/ Prepare Full #xtrabackup--prepare --apply-log-only --target-dir=/data/backups/mysql/ Apply Incremental #xtrabackup--prepare--apply-log-only --target-dir=/data/backups/full/sunday --incremental-dir=/data/backups/inc/tuesday/ 29 / 42
- 30. 30 / 42 Compression, Streaming, Encryption
- 31. Compression Compress using qpress #xtrabackup--backup--target-dir=/data/backups/ --compress--compress-threads=2 Decompress (before prepare) #xtrabackup--decompress--target-dir=/data/backups/ 31 / 42
- 35. 35 / 42 Cloud Backups - α
- 36. Cloud Backups - α Stream to Cloud directly Swift α 36 / 42
- 37. Cloud Backups - α Put #xtrabackup--backup--stream=xbstream--target-dir=/data/backups| xbcloudput--storage=Swift --swift-container=test--swift-user=test:tester --swift-auth-url=http://192.168.8.80:8080/ --swift-key=testing full_backup 37 / 42
- 38. Cloud Backups - α Put #xtrabackup--backup--stream=xbstream--target-dir=/data/backups| xbcloudput--storage=Swift --swift-container=test--swift-user=test:tester --swift-auth-url=http://192.168.8.80:8080/ --swift-key=testing full_backup Get #xbcloudget--storage=Swift --swift-container=test--swift-user=test:tester --swift-auth-url=http://192.168.8.80:8080/ --swift-key=testing full_backup|xbstream-xv-C/tmp/downloaded_full #xtrabackup--prepare--target-dir=/tmp/downloaded_full #xtrabackup--copy-back--target-dir=/tmp/downloaded_full 38 / 42
- 39. 39 / 42 Features
- 40. Backup Locks Implements LOCKTABLESFORBACKUPto Avoid FLUSHTABLESWITHREADLOCK, used for: Non-InnoDB Tables (mysqlschema... ) Binary Log Position Blocks DML to non-InnoDB Blocks DDL Allows Reads/Writes to InnoDB tables during 40 / 42
- 41. Change Page Tracking - Incremental Backups Incremental backup does no longer require reading all pages to determine if a page changed since the last full backup How: Percona Server tracks pages changed in InnoDB Tablespaces Incremental backup reads changed page file, only reads changed pages Why: Less load on database server (a lot less Disk IO) 41 / 42
- 42. Thank you ! Questions ? 42 / 42