Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

That's the process that we'll follow in order to carry out a security copyThis is a summary of the steps needed to perform a backup of a virtual machine:

  1. Bacula Director Daemon (backuo01backup01) has access to instructs the Bacula Client Daemon in order to start a copy of virtual01

  2. Bacula Client Daemon (production01) will check virtual01 status. In case it's running, it will be shutdown.
    If we want to carry out a a backup of a complete machine, it must be stopped or suspended. Otherwise, date will be corrupted recovery won't probably work correctly.
  3. Once the machine is shutdown, production01 will launch reflink in order to provide a file copy of the suspended virtual machine.
  4. After carrying out the copy of virtual01, production01 will be restored from its suspended status, and virtual01 will be started again.
  5. Once we have a copy of the virtual machine and the original one is running again, we compress the copy in order to minimize the copy transference to the backstorage and to save disk space.
  6. In the following step performs the snapshot of the virtual machine with the reflink command. There is no need to suspend or stop the virtual machine to make the copy.
  7. The copy is compressed, to reduce bandwidth and storage consumption.
  8. Then, Bacula Client Daemon (production01) must communicate instructs Bacula Storage Daemon (desarrollo01) in order to store the copy of virtual01 in backupstorage storagebackup.
  9. Finally, if the copy has been correctly carried out, files created during this process will be deleted by reflink instruction and the compression process. 

Bacula Director Daemon file, which is stored in backup01, must be configured with a new Job. A Job is a  used by Bacula to define backup tasks that need to be programmed. In order to do it you need to add three more fields to this configuration file. In the following example you can see how to add the client that will perform this new task:

Code Block
themeDJango
languagebash
  1. .

Now, we will detail the configuration of each component.

Configuration of Bacula Director Deamon

The backup process must be configured in the Bacula Director Deamon, hosted in backup01, in the file /etc/bacula-dir.conf. Job is the Bacula term for the backup tasks that must be scheduled. To define a new Job, you have to add 3 new elements to that configuration file. The first one is the client that will perform the Job:

Code Block
languagebash
themeDJango
Client {
  Name = produccion01-fd
  Address = produccion01    # IP
  FDPort = 9102
  Catalog = MyCatalog
  Password = "produccion01-fd.password"
  File Retention = 1 year
  Job Retention = 1 year
  AutoPrune = yes
  Maximum Concurrent Jobs = 10
}
Now, you must define

The second one is the storage where the client will

store the security copy:

 

code

write the backup.

Code Block
languagebash
themeDJango
languagebash
Storage {
     
  Name = "storage_virtual01_full"

       Address = desarrollo01
     
  SDPort = 9103
 
      Password = "desarrollo01-sd.password"
     
  Device = backup_erp01_full
  
     Maximum Concurrent Jobs = 10
        Media Type = "file_virtual01_full"
}
Finally, you must add the Job that
has to
must be carried out by the Client
.
:

 

Code Block
languagebash
themeDJango
languagebash
Schedule {
  Name = "schedule_virtual01_full"
  Run = Level=Full Pool=pool_mensual on 1,16 at 3:00
  Run = Level=Full Pool=pool_quincenal sun-sat at 3:00
}
FileSet {
  Name = "fileset_virtual01_full"
  Include {
    Options { signature = SHA1; onefs = yes; }
    File = /storage/virtual01-
bk.tar
bak.gz
  }
}
Job {
  Name = "job_virtual01_full"
  Type = Backup
  Level = Full
  Client = produccion01-fd
  FileSet = "fileset_virtual01_full"
  Schedule = "schedule_virtual01_full"
  Storage = "storage_virtual01_full"
  Messages = Standard
  Pool = pool_anual
  Full Backup Pool = pool_mensual
  Incremental Backup Pool = pool_quincenal
  Priority = 11
  Write Bootstrap = "/apps/bacula/opt/bacula/working/virtual01_full.bsr"
  ## Script running on client
  Client Run Before Job = "/apps/bacula/script/
vm
backup_full_
stop
guest.sh virtual01"
  Client Run After Job = "/apps/bacula/script/
vm_start
remove_backup_full_guest.sh virtual01"	
}
We must point out that the directory we want to copy has been configured in the code from the left section

There are two things that are worth noting in that configuration. The first one is the file that is going to be copied, in section FileSet:

 

Code Block
languagebash
themeDJango
languagebash
File = /storage/virtual01-
bk.tar
bak.gz

 

And those are the scripts that will stop and restore virtual01 and that will delete the files created whil doing the security copy. Those scripts will be

The second one is the declaration of the scripts in charge of copying and compressing the virtual01 image, on one hand, and removing those files afterwards, on the other. This is done in section Job. Those scripts are detailed later on.

 

Code Block
languagebash
themeDJango
languagebash
Client Run Before Job = "/apps/bacula/script/
vm
backup_full_
stop
guest.sh virtual01"
Client Run After Job = "/apps/bacula/script/
vm_start
remove_backup_full_guest.sh virtual01"

If you want to know with more detail the rest of settings that have be configured, you can visit the Bacula documentation (www.bacula.org).
once you have defined the Jobe in

Configuration of Bacula Storage Daemon

Once the Job is defined in the Bacula Director Daemon, we need to create the you must create a Device (location place where the security copy for virtual01 backup will be stored) in the Bacula Storage Daemon   (development01desarrollo01). In order to do this, we must edit It is done in the configuration file (.../bacula/etc/bacula-sd.conf) and add , adding the following lines.:

Code Block
languagebash
themeDJango
languagebash
Device {
    
   Name = backup_virtual01_full
     
  Media Type = file_erp01_sql
        Archive Device = /backup/vm/virtual01

       LabelMedia = yes;                      
     Random Access = Yes;
 
      AutomaticMount = yes;                    
  RemovableMedia = no;
  
     AlwaysOpen = no;
        Maximum Concurrent Jobs = 10
}

Configuration of Bacula Client Daemon

Finally, we need to define two scripts:

the first one will stop

, to perform the snapshot of the virtual machine

in order to do the copy and restoration
  • the second one will delete the security copy already copied in storagebackup.
  • Both scripts must be located in production01 (Bacula Client Daemon)

     

    Code Block
    themeDJango
    languagebash
    titlevm_stop.sh
    ##/bin/bash
      
    PASS=`cat /root/pass`
    MACHINE=$1
    LOGFILE=/bacula/log/log_$MACHINE.log
    DATE=`date +%d%m%Y`
    echo " " >> $LOGFILE
    echo "-------------------------------" $MACHINE "--" `date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` "---------------------------------------" >> $LOGFILE
    ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
    if [ $ESTADO = "running" ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE esta en ejecucion, se suspende..." >> $LOGFILE
    flexadm -p $PASS -g $MACHINE suspend -w
    sleep 300
    ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
    if [ $ESTADO = "running" ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE No se ha suspendido después de 5 minutos se suspende la copia." >> $LOGFILE
    flexadm -p $PASS -g $1 restore -w #Asegurar que la maquina queda en ejecucion
    elif [ $ESTADO = "suspended" ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE se ha suspendido, se crea backup ($MACHINE-bk)." >> $LOGFILE
    LUGAR=`flexadm -p $PASS -g $1 guest-images`
    reflink $LUGAR $LUGAR-bk
    if [ $? -eq 0 ]
    then
    if [ -f $LUGAR-bk ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk creado, se comprime ($MACHINE-bk_$DATE.tar.gz)." >> $LOGFILE
    fi
    tar -cf $LUGAR-bk_$DATE.tar.gz $LUGAR-bk
    if [ $? -eq 0 ]
    then
    if [ -f $LUGAR-bk_$DATE.tar.gz ]
    then
    echo "`date
     +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk comprimida
     ($MACHINE-bk_$DATE.tar.gz), se borra $MACHINE-bk." >> $LOGFILE
    rm -rf $LUGAR-bk
    if [ $? -eq 0 ]
    then
    if [ ! -f $LUGAR-bk ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk borrada." >> $LOGFILE
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` Backup  de $MACHINE creado correctamente." >> $LOGFILE
    fi
    else
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL BORRAR $MACHINE-bk" >> $LOGFILE
    fi
    fi
    else
    echo "`date
     +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL COMPRIMIR 
    $MACHINE-bk NO SE HA CREADO ($MACHINE-bk_$DATE.tar.gz)" >> $LOGFILE
    fi
    else
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL CREAR $MACHINE-bk" >> $LOGFILE
    fi
    fi
    elif [ $ESTADO = "suspended" ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE suspendida" >> $LOGFILE
    fi
    echo "--------------------------------------------------------------------------------------------------------" >> $LOGFILE

     

     

    Code Block
    themeDJango
    languagebash
    titlevm_delete.sh
    #!/bin/bash PASS=`cat /root/pass` MACHINE=$1

    and remove it once it is transferred to storagebackup. These scripts will be stored in the Bacula Client Daemon (produccion01).

    Code Block
    languagebash
    themeDJango
    titlebackup_full_guest.sh
    #!/bin/sh
    MACHINE=$1
    [ -n "$MACHINE" ] || {
            echo Usage: ./backup_full_guest.sh guest_name
            exit 1
    }
    LOGFILE=/apps/bacula/log/log_$MACHINE.log
    log() {
            echo $(date "+%d-%m-%Y %H:%M") "$@" >> $LOGFILE
    }
    log
    IMAGE="/storage/$MACHINE"
    [ -f "$IMAGE" ] || {
            log ERROR: GUEST $MACHINE DOES NOT EXIST
            exit 1
    }
    BAK="$IMAGE-bak"
    
    log "---- Reflink ---- $MACHINE ----"
    if ! reflink "$IMAGE" "$BAK"; then
            log ERROR CREATING $MACHINE SNAPSHOT
            exit 1
    fi
    log Reflink of $MACHINE succeeded.
    if ! gzip "$BAK"; then
            log ERROR COMPRESSING THE BACKUP
            exit 1
    fi
    log Image compressed

     

     

    Code Block
    languagebash
    themeDJango
    titleremove_backup_full_guest.sh
    #!/bin/sh
    MACHINE=$1
    [ -n "$MACHINE" ] || {
            echo Usage: ./remove_backup_full_guest.sh guest_name
            exit                                                                                                 
     
    LOGFILE=1
    }
    LOGFILE=/apps/bacula/log/log_$MACHINE.log
    log() {
            echo                                                                                   
    DATE=`date +%d%m%Y`                                                                                                                    
    echo " " >>
     
    $LOGFILE                                                                                                                  
     
    echo "-------------------------------" $MACHINE "--" `date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` "---------------------------------------" >> $LOGFILE $(date "+%d-%m-%Y %H:%M") "$@" >> $LOGFILE
    }
    log
    IMAGE="/storage/$MACHINE"
    BAK="$IMAGE-bak.gz"
    [ -f "$BAK" ] || {
            log ERROR: THE BACKUP OF $MACHINE DOES NOT EXIST
            exit 1
    }
    
                                                                                  
    ESTADO=`flexadm guest-status -p $PASS -g $MACHINE`
    if [ $ESTADO = "running" ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE esta restaurada" >> $LOGFILE
    LUGAR=`flexadm -p $PASS -g $MACHINE guest-images`
    if [ -f $LUGAR-bk.tar.gz ]
    then
    rm -rf $LUGAR-bk.tar.gz
    if [ $? -eq 0 ]
    then
    if [ ! -f $LUGAR-bk.tar.gz ]
    then
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz borrado con exito" >> $LOGFILE
    else
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz no se ha borrado" >> $LOGFILE
    fi
    else
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` ERROR AL BORRAR $MACHINE-bk.tar.gz" >> $LOGFILE
    fi
    else
    echo "`date +%d`-`date +%m`-`date +%Y` `date +%H`:`date +%M` $MACHINE-bk.tar.gz no existe" >> $LOGFILE
    fi
    fi
    echo "--------------------------------------------------------------------------------------------------------" >> $LOGFILElog "---- Remove ---- $MACHINE ----"
    if ! rm -f "$BAK"; then
            log ERROR REMOVING $BAK
            exit 1
    fi
    log Backup removed