-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
implement ZFS-backed rsnapshot backup #1325
Draft
singingtelegram
wants to merge
58
commits into
master
Choose a base branch
from
zfs-backup
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
singingtelegram
commented
Oct 19, 2022
•
edited
Loading
edited
- provision ZFS & tools on host
- backup status
- snapshot check
- provision keys
- validate still working after quoting
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
This reverts commit be1b32c.
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 23
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
singingtelegram
force-pushed
the
zfs-backup
branch
from
October 26, 2022 05:13
76a66d0
to
bca06eb
Compare
singingtelegram
force-pushed
the
zfs-backup
branch
from
October 26, 2022 05:15
bca06eb
to
cf4adcd
Compare
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 15
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (0)Changed hosts (1)Unaffected hosts (77)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (1)Changed hosts (1)Unaffected hosts (77)Errored hostserror for newton.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (1)Changed hosts (1)Unaffected hosts (77)Errored hostserror for newton.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (2)Changed hosts (1)Unaffected hosts (79)Errored hostserror for jaws.ocf.berkeley.edu
error for newton.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (2)Changed hosts (1)Unaffected hosts (79)Errored hostserror for jaws.ocf.berkeley.edu
error for newton.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh
hour =>
- 2
+ 22
minute =>
- 0
+ 20
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (1)Changed hosts (1)Unaffected hosts (79)Errored hostserror for jaws.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
hour =>
- 2
+ 03
minute =>
- 0
+ 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
parameters =>
"backup": "main",
"content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
timestamp file on source is empty
Co-authored-by: rmxu <[email protected]>
The people removed were notified last semester, kmo requested an extension to the end of that semester, so that was done.
* fix: don't redirect on ocf.b.e * fix: it's actually here, see if it works * fix: it works * fix: remove server cors not necessary * fix: wrong one
* Add slidingsync.matrix to load balancer * Add sliding sync to matrix/client well-known
fix SSL config to support TLS 1.2, update cipher list
* feat: smart monitoring
Errored hosts (1)Changed hosts (1)Unaffected hosts (64)Errored hostserror for segfault.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
hour =>
- 2
+ 03
minute =>
- 0
+ 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
parameters =>
"backup": "main",
"content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Errored hosts (1)Changed hosts (1)Unaffected hosts (64)Errored hostserror for segfault.ocf.berkeley.edu
Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
hour =>
- 2
+ 03
minute =>
- 0
+ 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
parameters =>
"backup": "main",
"content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
This reverts commit a2035a1.
Errored hosts (0)Changed hosts (1)Unaffected hosts (56)Changed hostsdiff for hal.ocf.berkeley.edu*******************************************
- Cron[check-rsnapshot-backups]
*******************************************
Cron[rsnapshot-daily] =>
parameters =>
command =>
- rsnapshot -c /opt/share/backups/rsnapshot.conf sync && rsnapshot -c /opt/share/backups/rsnapshot.conf daily
+ /usr/local/sbin/backup-zfs.sh | tee -a /var/log/zfs-backup.log
hour =>
- 2
+ 03
minute =>
- 0
+ 00
*******************************************
- Cron[rsnapshot-monthly]
*******************************************
- Cron[rsnapshot-weekly]
*******************************************
+ File[/etc/logrotate.d/backup-zfs] =>
parameters =>
"backup": "main",
"content": "/var/log/ocf-backup-zfs.log {\n\trotate 100\n\tdaily\n\tcompress...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
File[/opt/share/backups/backup-mysql] =>
parameters =>
content =>
@@ -19,3 +19,3 @@
--routines \
--single-transaction \
- --databases {} | pigz > "mysql-{}-$(date +%F).sql.gz"' -- $databases
+ --databases {} > "mysql-{}-$(date +%F).sql"' -- $databases
*******************************************
File[/opt/share/backups/backup-pgsql] =>
parameters =>
content =>
@@ -4,3 +4,3 @@
# Dumps the entire PostgreSQL instance to one .sql file.
# Requires that a valid ~/.pgpass file be available on the PostgreSQL host
-ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost | pigz' > "pgsql-all-$(date +%F).sql.gz"
+ssh -K ocfbackups@postgres 'pg_dumpall -U postgres -h localhost' > "pgsql-all-$(date +%F).sql"
*******************************************
+ File[/opt/share/backups/offsite-host] =>
parameters =>
"backup": "main",
"content": "dummyhost",
"group": "root",
"mode": "0400",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-git.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-mysql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs-pgsql.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/opt/share/backups/rsnapshot-zfs.conf] =>
parameters =>
"backup": "main",
"content": "#################################################\n# rsnapshot.c...
"group": "root",
"mode": "0644",
"owner": "root"
*******************************************
+ File[/usr/local/sbin/backup-zfs.sh] =>
parameters =>
"backup": "main",
"content": "#!/bin/bash\n\nCURRENT_SNAPSHOT_FILE=/opt/share/backups/current-...
"group": "root",
"mode": "0755",
"owner": "root"
******************************************* Unaffected hosts
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.