Page Comparison

That's the process that we'll follow in order to carry out a security copyThis is a summary of the steps needed to perform a backup of a virtual machine:

Bacula Director Daemon (backuo01backup01) has access to instructs the Bacula Client Daemon in order to start a copy of virtual01.
Bacula Client Daemon (production01) will check virtual01 status. In case it's running, it will be shutdown.
If we want to carry out a a backup of a complete machine, it must be stopped or suspended. Otherwise, date will be corrupted recovery won't probably work correctly.
Once the machine is shutdown, production01 will launch reflink in order to provide a file copy of the suspended virtual machine.
After carrying out the copy of virtual01, production01 will be restored from its suspended status, and virtual01 will be started again.
Once we have a copy of the virtual machine and the original one is running again, we compress the copy in order to minimize the copy transference to the backstorage and to save disk space.
In the following step performs the snapshot of the virtual machine with the reflink command. There is no need to suspend or stop the virtual machine to make the copy.
The copy is compressed, to reduce bandwidth and storage consumption.
Then, Bacula Client Daemon (production01) must communicate instructs Bacula Storage Daemon (desarrollo01) in order to store the copy of virtual01 in backupstorage storagebackup.
Finally, if the copy has been correctly carried out, files created during this process will be deleted by reflink instruction and the compression process.

Bacula Director Daemon file, which is stored in backup01, must be configured with a new Job. A Job is a used by Bacula to define backup tasks that need to be programmed. In order to do it you need to add three more fields to this configuration file. In the following example you can see how to add the client that will perform this new task:

Code Block

theme	DJango
language	bash

.

Now, we will detail the configuration of each component.

Configuration of Bacula Director Deamon

The backup process must be configured in the Bacula Director Deamon, hosted in backup01, in the file /etc/bacula-dir.conf. Job is the Bacula term for the backup tasks that must be scheduled. To define a new Job, you have to add 3 new elements to that configuration file. The first one is the client that will perform the Job:

Code Block

language	bash
theme	DJango

Client {
  Name = produccion01-fd
  Address = produccion01    # IP
  FDPort = 9102
  Catalog = MyCatalog
  Password = "produccion01-fd.password"
  File Retention = 1 year
  Job Retention = 1 year
  AutoPrune = yes
  Maximum Concurrent Jobs = 10
}

Now, you must define

The second one is the storage where the client will

store the security copy:

code

write the backup.

Code Block

language	bash
theme	DJango
language	bash

Storage {
     
  Name = "storage_virtual01_full"
        Address = desarrollo01
     
  SDPort = 9103
        Password = "desarrollo01-sd.password"
     
  Device = backup_erp01_full

       Maximum Concurrent Jobs = 10
     
  Media Type = "file_virtual01_full"
}

Finally, you must add the Job that

has to

must be carried out by the Client

.

:

Code Block

language	bash
theme	DJango

languagebash

Schedule {
  Name = "schedule_virtual01_full"
  Run = Level=Full Pool=pool_mensual on 1,16 at 3:00
  Run = Level=Full Pool=pool_quincenal sun-sat at 3:00
}
FileSet {
  Name = "fileset_virtual01_full"
  Include {
    Options { signature = SHA1; onefs = yes; }
    File = /storage/virtual01-

bk

bak.

tar.

gz
  }
}
Job {
  Name = "job_virtual01_full"
  Type = Backup
  Level = Full
  Client = produccion01-fd
  FileSet = "fileset_virtual01_full"
  Schedule = "schedule_virtual01_full"
  Storage = "storage_virtual01_full"
  Messages = Standard
  Pool = pool_anual
  Full Backup Pool = pool_mensual
  Incremental Backup Pool = pool_quincenal
  Priority = 11
  Write Bootstrap = "/apps/bacula/opt/bacula/working/virtual01_full.bsr"
  ## Script running on client
  Client Run Before Job = "/apps/bacula/script/

vm

backup_full_

stop

guest.sh virtual01"
  Client Run After Job = "/apps/bacula/script/

vm_start

remove_backup_full_guest.sh virtual01"

We must point out that the directory we want to copy has been configured in the code from the left section

There are two things that are worth noting in that configuration. The first one is the file that is going to be copied, in section FileSet:

Code Block

language	bash
theme	DJango

languagebash

File = /storage/virtual01-

bk.tar

bak.gz

And those are the scripts that will stop and restore virtual01 and that will delete the files created whil doing the security copy. Those scripts will be

The second one is the declaration of the scripts in charge of copying and compressing the virtual01 image, on one hand, and removing those files afterwards, on the other. This is done in section Job. Those scripts are detailed later on.

Code Block

language	bash
theme	DJango

languagebash

Client Run Before Job = "/apps/bacula/script/

vm

backup_full_

stop

guest.sh virtual01"
Client Run After Job = "/apps/bacula/script/

vm_start

remove_backup_full_guest.sh virtual01"

If you want to know with more detail the rest of settings that have be configured, you can visit the Bacula documentation (www.bacula.org).

once you have defined the Jobe in

Configuration of Bacula Storage Daemon

Once the Job is defined in the Bacula Director Daemon, we need to create the you must create a Device (location place where the security copy for virtual01 backup will be stored) in the Bacula Storage Daemon (development01desarrollo01). In order to do this, we must edit It is done in the configuration file (.../bacula/etc/bacula-sd.conf) and add , adding the following lines.:

Code Block

language

language	bash
theme	DJango		bash

Device {
        Name = backup_virtual01_full
        Media Type = file_erp01_sql
   
    Archive Device = /backup/vm/virtual01
        LabelMedia = yes;                        
   Random Access = Yes;
        AutomaticMount = yes;                    
  RemovableMedia = no;
        AlwaysOpen = no;
     
  Maximum Concurrent Jobs = 10
}

Configuration of Bacula Client Daemon

Finally, we need to define two scripts:

the first one will stop

, to perform the snapshot of the virtual machine

in order to do the copy and restoration

the second one will delete the security copy already copied in storagebackup.

Both scripts must be located in production01 (Bacula Client Daemon)

Code BlockthemeDJangolanguagebash

and remove it once it is transferred to storagebackup. These scripts will be stored in the Bacula Client Daemon (produccion01).

Code Block

language	bash
theme	DJango
title	vm_stop.sh

###!/bin/bash
  
PASS=`cat /root/pass`
sh
MACHINE=$1
LOGFILE=/bacula/log/log_$MACHINE.log
DATE=`date +%d%m%Y`
echo " " >> $LOGFILE
echo "-------------------------------" $MACHINE "--" `date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` "---------------------------------------" >> $LOGFILE
ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
if [ $ESTADO = "running" ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE esta en ejecucion, se suspende..." >> $LOGFILE
flexadm -p $PASS -g $MACHINE suspend -w
sleep 300
ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
if [ $ESTADO = "running" ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE No se ha suspendido después de 5 minutos se suspende la copia." >> $LOGFILE
flexadm -p $PASS -g $1 restore -w #Asegurar que la maquina queda en ejecucion
elif [ $ESTADO = "suspended" ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE se ha suspendido, se crea backup ($MACHINE-bk)." >> $LOGFILE
LUGAR=`flexadm -p $PASS -g $1 guest-images`
reflink $LUGAR $LUGAR-bk
if [ $? -eq 0 ]
then
if [ -f $LUGAR-bk ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk creado, se comprime ($MACHINE-bk_$DATE.tar.gz)." >> $LOGFILE
fi
tar -cf $LUGAR-bk_$DATE.tar.gz $LUGAR-bk
if [ $? -eq 0 ]
then
if [ -f $LUGAR-bk_$DATE.tar.gz ]
then
echo "`date
 +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk comprimida
 ($MACHINE-bk_$DATE.tar.gz), se borra $MACHINE-bk." >> $LOGFILE
rm -rf $LUGAR-bk
if [ $? -eq 0 ]
then
if [ ! -f $LUGAR-bk ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk borrada." >> $LOGFILE
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` Backup  de $MACHINE creado correctamente." >> $LOGFILE
fi
else
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL BORRAR $MACHINE-bk" >> $LOGFILE
fi
fi
else
echo "`date
 +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL COMPRIMIR 
$MACHINE-bk NO SE HA CREADO ($MACHINE-bk_$DATE.tar.gz)" >> $LOGFILE
fi
else
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL CREAR $MACHINE-bk" >> $LOGFILE
fi
fi
elif [ $ESTADO = "suspended" ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE suspendida" >> $LOGFILE
fi
echo "--------------------------------------------------------------------------------------------------------" >> $LOGFILE

Code BlockthemeDJangolanguagebash

[ -n "$MACHINE" ] || {
        echo Usage: ./backup_full_guest.sh guest_name
        exit 1
}
LOGFILE=/apps/bacula/log/log_$MACHINE.log
log() {
        echo $(date "+%d-%m-%Y %H:%M") "$@" >> $LOGFILE
}
log
IMAGE="/storage/$MACHINE"
[ -f "$IMAGE" ] || {
        log ERROR: GUEST $MACHINE DOES NOT EXIST
        exit 1
}
BAK="$IMAGE-bak"

log "---- Reflink ---- $MACHINE ----"
if ! reflink "$IMAGE" "$BAK"; then
        log ERROR CREATING $MACHINE SNAPSHOT
        exit 1
fi
log Reflink of $MACHINE succeeded.
if ! gzip "$BAK"; then
        log ERROR COMPRESSING THE BACKUP
        exit 1
fi
log Image compressed

Code Block

language	bash
theme	DJango
title	vm_delete.sh

#!/bin/bash                                                                                                                           
 
                                                                                                                                        
PASS=`cat /root/pass`                                                                                                                  
MACHINE=$1      sh
MACHINE=$1
[ -n "$MACHINE" ] || {
        echo Usage: ./remove_backup_full_guest.sh guest_name
        exit                                                                                                 
 
LOGFILE=1
}
LOGFILE=/apps/bacula/log/log_$MACHINE.log
log() {
        echo                                                                                   
DATE=`date +%d%m%Y`                                                                                                                    
echo " " >>
 
$LOGFILE                                                                                                                  
 
echo "-------------------------------" $MACHINE "--" `date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` "---------------------------------------" >> $LOGFILE $(date "+%d-%m-%Y %H:%M") "$@" >> $LOGFILE
}
log
IMAGE="/storage/$MACHINE"
BAK="$IMAGE-bak.gz"
[ -f "$BAK" ] || {
        log ERROR: THE BACKUP OF $MACHINE DOES NOT EXIST
        exit 1
}

                                                                              
ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
if [ $ESTADO = "running" ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE esta restaurada" >> $LOGFILE
LUGAR=`flexadm -p $PASS -g $MACHINE guest-images`
if [ -f $LUGAR-bk.tar.gz ]
then
rm -rf $LUGAR-bk.tar.gz
if [ $? -eq 0 ]
then
if [ ! -f $LUGAR-bk.tar.gz ]
then
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz borrado con exito" >> $LOGFILE
else
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz no se ha borrado" >> $LOGFILE
fi
else
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL BORRAR $MACHINE-bk.tar.gz" >> $LOGFILE
fi
else
echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz no existe" >> $LOGFILE
fi
fi
echo "--------------------------------------------------------------------------------------------------------" >> $LOGFILElog "---- Remove ---- $MACHINE ----"
if ! rm -f "$BAK"; then
        log ERROR REMOVING $BAK
        exit 1
fi
log Backup removed

Versions Compared

Old Version 6

New Version 7

Key

Configuration of Bacula Director Deamon

Configuration of Bacula Storage Daemon

Configuration of Bacula Client Daemon