Editing CommunityData:Backups (nada)
From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
'''nada.com.washington.edu''' (our main Internet-connected research server at the University of Washington) has about 14TB of available disk space. | '''nada.com.washington.edu''' (our main Internet-connected research server at the University of Washington) has about 14TB of available disk space. Although we want to backup thing everything by default, backing up all 14TB would cost about $140/month. As a result, we should be smart about what/how we back things up. | ||
Although we | |||
== Backups on Nada == | == Backups on Nada == | ||
Nada backups are | Nada backups are systemwide backups using [http://duplicity.nongnu.org/ Duplicity]. The backups are incremental backups using [http://www.nongnu.org/rdiff-backup/ rdiff backup] (think [https://rsync.samba.org/ rsync]), are encrypted using GPG, and then are stored in [https://cloud.google.com/storage/docs/nearline?hl=en Google Nearline storage] which costs about $0.01/GB. | ||
Backups scripts run once each week. | |||
Everything is backed up except for the directories listed in <code>/root/duplicitity_exclude</code>. This page may not be up to date but the following files | Everything is backed up except for the directories listed in <code>/root/duplicitity_exclude</code>. This page may not be up to date but the following files are '''excluded''' at the time that this page was written: | ||
/mnt | /mnt | ||
Line 39: | Line 38: | ||
=== MySQL Backups === | === MySQL Backups === | ||
MySQL databases '''are''' backed up using a separate MySQL incremental backup script that calls [https://www.percona.com/software/mysql-database/percona-xtrabackup Percona XtraBackup]. These incremental MySQL backups are created once each week before the duplicity backup script is run. To add a new MySQL database to the backup list, you must edit the following files: | |||
/usr/local/sbin/mysql_backup_full | /usr/local/sbin/mysql_backup_full |