bacula systems sa

BaculaSystemsSA

Bacula Open Source Project Bacula Systems (professional support)

TheEnterpriseReadyOpenSourceNetworkBackupSolu<on

Kern Sibbald

BaculaSystemsSA

Introduction – What is Bacula?

•  Anetworkbackupsolu<ondesignedfor*BSD,Linux,MacOSX,UnixandWindowssystems

•  Projectgoalsareto:  BackupanyclientfromaPalmtoamainframecomputer

  Provide«Enterprise»featuressimilartothelargestcommercialapplica<onsinanOpenSourcesolu<on

  Assuredatacompa<bilityfor30years(providingthatappropriatehardwareisavailable)

  UseaFreeandOpenSource(GPLv2)license

BaculaSystemsSA

Introduction – Project History

•  «Bacula»=Backup+Dracula  Itcomesbynightandsucksthevitalessencefromyourcomputers.

•  Timeline  January2000–Projectstarted  14April2002–FirstreleasetoSourceForge(version1.16)  29June2006–Release1.38.11  January2007–Release2.0.0  August2007–Release2.2.0  June2008–Release2.4.0  July2009–Currentrelease3.0.2

•  Downloadstodate:(Sep2009)  1,027,109allversions

  6.9TB

BaculaSystemsSA

Bacula Download History

Release 3.0.2

BaculaSystemsSA

Why Backup?

•  HardwareFailureProtec<on

•  UnauthorizedIntrusion(Hackers)

•  VirusProtec<on

•  UserErrorProtec<on

•  ServiceLevelAgreements

•  Legaland/orRegulatoryRequirements

•  BusinessCostofTime/DataLoss

•  DisasterRecovery

BaculaSystemsSA

What is «Backup»?

•  Dataprotec<on  Allfiles

  Databases(MySQL,PostgreSQL,MSSQL,Oracle,DB2,…)

  Applica<ons(E‐mail:MSExchange,Lotus,...)

  Groupwareapplica<ons(LotusNotes,etc.)

  EnterpriseResourcePlanning(ERP)

  CRMandsalesorderentrysystems

  Others…

BaculaSystemsSA

What is «Backup»?

•  Off‐sitebackup  Storingcopiesoff‐site

•  Disasterrecoveryplan(DRP)  BareMetalrecovery

  Serverconfigura<on

  BaculaCatalogdatabase

  Baculabinariesandconfigura<onfiles

  Keypeopletobecontacted

  Loca<onofrecoverymedia

BaculaSystemsSA

What is «Backup»?

•  Archiving  Compliancewithregulatory

requirements

  Businessrequirements

  Longreten<on(7‐30years)

  Guaranteesdataarenotchangedordeleted

  Auditrequirements

Module 1

BaculaSystemsSA

Reflection – Key Questions

•  Doyoudobackups?  No  Yes,Ididonelastmonth  Yes,tarfileseveryweek  Some<mesIrsync...  Yes,CDseveryweek  Iusecustomscripts

•  Haveyouencounteredthetypicalproblems?  Retrievingandrestoring:

•  Howtofindthefilesyouneedtorestore?•  Howtorestoretoapointin<me?•  Whichfilesareonwhichmedium?

  Scalability:•  Couldthesolu<onhandle2000+machines?

  Compliance:•  Canthesolu<onassurethatallgovernmentregula<onsaremet?

BaculaSystemsSA

Introduction – the Bacula Solution

•  OpenSource(GPLv2)

•  Centrallymanaged

•  Networkbackup/restore

•  Mul<‐plarormsupport(*BSD,Linux,MacOSX,UnixWin32,...)

•  Differentmedia(Tape,disk,USB,CD/DVD)

•  Reliable

•  Trackscomprehensivelywhatwasbackedupwhenandwhere

•  Allowsrestora<onofspecificfilesrequired(Catalog+GUI)

•  Restorestoapointin<me

•  Scalestohandle10,000machines

BaculaSystemsSA

What is Bacula?

•  Enterprisebackupsolu<on  Networkbased  CentralizedAdministra<on  Automa<copera<on  Performsbookkeeping  Mul<‐plarorm  Manyhigh‐endfeatures

•  Robustdesignbuiltforhighperformance  Modular  Mul<pleBackupMedia  Customizable  Reliable  RapidRestores  AdvancedRepor<ng,No<fica<on,Monitoring

BaculaSystemsSA

What is Bacula?

•  OpenSource  Zero‐costlicense

  Largecommunityofusersanddevelopers

  Abilitytocustomizetoyourspecificrequirements•  Extensiveconfigura<on

•  ContributetoBaculaProject

  Securityofsolu<onguaranteed•  Usershavethesourcecode

•  Nolicenseaudits

Module 1

BaculaSystemsSA

Architecture – 5 Bacula Components Module 1

BaculaSystemsSA

Architecture – 5 Bacula Components

•  Director(DIR)  Centralizedcontrolandadministra<onforallfunc<ons

  BasicunitisaJob(oneclient,onesetoffiles,...)

  Schedules,ini<atesandsupervisesallJobs

  Maintainsthecatalog(SQLdatabase)

•  Typicalinstalla<on  OneDirectorperBaculainstalla<on

  Excep<on–verylargeenvironmentsthat

requireaddi<onalcoordina<on

BaculaSystemsSA


•  FileDaemonorClient(FD)  Performsfilebackup,restoreandverifica<onrequestedbyDirector

  Installedoneachmachineasaservice(daemon)

  CommunicatesovernetworkwithDirectorandStoragedaemon

  Needsaccesstoallfilestobebackedup(root,SYSTEM)

•  Typicalinstalla<on  Mul<pleFiledaemonsperDirector

•  Oneforeachmachine

6.3

BaculaSystemsSA


•  Storagedaemon(SD)  Readsandwritesdatatothephysicalmedium

  Disk,Tape,CD/DVD,USB,...

  Acceptsordersandauthoriza<onfromtheDirector

  Acceptsandreturnsdatato/fromFiledaemons(FD)

  Sendsfilestorageloca<ontoDirector‐>Catalog

  Supportsmul<pledevicesperSD

•  Typicalinstalla<on  OneSDperDirector

BaculaSystemsSA


•  Console  AllowsuseroradministratortocontrolBacula  CommunicateswithDirectorvianetwork

  Startjobs,reviewJoboutput,query/modifycatalog

•  Consolesavailable  TTY(bconsole)  bataQt4(GUI)–mostcomprehensive

  wxWidgets(GUI)–Linux,Unix,Win32  Mul<plewebinterfaces

•  bweb=mostcomprehensive

  Restrictedconsoles•  Userscanrestoretheirownfiles

BaculaSystemsSA


•  Catalogdatabase  OnlycomponentnotwriuenbyBaculateam

  SQLdatabase(MySQL,PostgreSQL,orSQLite)–unique

  TracksJobsrun,Volumesused,Fileloca<ons,...

  Permitsrapidrestores

  Allowsinquiryofwhenandwherefileswerebackedup

  Olddataautoma<callyprunedbyDirector

  Supportsmul<pledatabasesforscaling

BaculaSystemsSA

Bacula Release Files

•  bacula‐3.0.2.tar.gz  PrimaryBaculasourcecode

release

•  bacula‐docs‐3.0.2.tar.bz2  Prebuiltdocs:HTML

directory,singleHTMLfile,andPDFfile..

•  bacula‐gui‐3.0.2.tar.gz  Non‐coreGUIprograms  bweb  bacula‐web  Bimagemgr

•  programforburningCDROMimageswithBaculaVolumes

•  bacula‐rescue‐3.0.2.tar.gz  BareMetalRecovery  CD‐ROMdepreciated  ReplacedbyUSBkey

•  winbacula‐3.0.2.exe  32‐bitinstallerfor

Windows®client(FileDaemon)

•  win64bacula‐3.0.2.exe  64‐bitinstallerfor

Windows®client(FileDaemon)

BaculaSystemsSA

Bacula Administration Tool (BAT)

•  GUIformofbconsole–withmanyaddi<onalfeatures

•  Keyfeatures  Graphicalrepresenta<onofJobsrunbyBacula

  Abilitytocreatereportsmoreeasilyandquickly

  Sor<ngofrun/failedJobsbyclickingonthecolumnheader

  Contextsensi<vemenuwithreadyaccesstokeyfeatures

BaculaSystemsSA

The BAT Interface

BaculaSystemsSA

The BAT Interface – Job List

BaculaSystemsSA

The BAT Interface – Job Log

BaculaSystemsSA

The BAT Interface – Volume Actions

BaculaSystemsSA

The BAT Interface – Running a Job Module 4

BaculaSystemsSA

The BAT Interface – Restoring Files Module 4

BaculaSystemsSA

Bweb Management Interface

•  Webbasedmanagementtool

•  Keyfeatures  Graphicalrepresenta<onofJobsrunbyBacula

  Abilitydrillintoproblemareas

  Restartfailedjobs

  Pointandclickautochangercontrol

  Volumeloca<ontracking

  Jobgrouping

BaculaSystemsSA

Main Bweb Window

BaculaSystemsSA

Job Log for Failed Job

BaculaSystemsSA

Job Log for Job with Warnings

BaculaSystemsSA

Media View (in Catalog)

BaculaSystemsSA

Autochanger View (in changer)

BaculaSystemsSA

Bacula Reliability

•  Reliabilitydesignedinfromthebeginning

•  Lowlevelmemoryclobberandbufferlosschecking

•  Owncodeforvprinr–avoidsexploits

•  10–20%ofcodecleanedup(refactored)eachrelease

•  Extensiveregressiontes<ng

•  Userregressiontes<ngpostedondashboardnightlyfrommanymachines

BaculaSystemsSA

Bacula Test Dashboard

BaculaSystemsSA

Failed Job

BaculaSystemsSA

Failed Job Details

BaculaSystemsSA

Open Bugs Database

•  Bugsdatabaseopentoeveryone

•  Canfindfixestounusualproblems

•  hup://bugs.bacula.org

BaculaSystemsSA

Bacula Bugs Database

BaculaSystemsSA

Development Roadmap

•  Version3.0.3bugfixtobereleasedbymid‐October

•  Version3.2.0tobereleasedaxer1January2010

•  New3.2.0features  MaximumConcurrentJobsforDevices

  EnhancementstoAccuratebackup

  Restorefrommul<pleStoragedaemons

  Filededuplica<onwithBaseJobs

  BaculavirtualcatalogfilesystemAPI

  Enhancedtapedrivetes<ngfunc<onality

BaculaSystemsSA

Development Roadmap (cont)

•  New3.2.0features  Disableblockchecksums(performance)

  NewBatfunc<onality

  RestartfailedJobsrecoveringwhatwasalreadysave

  Filedaemondropsrootpermissionbutcanbackupallfiles

BaculaSystemsSA

Future Projects

•  Deduplica<on  BaseJobdeduplica<on  “rsync”toservertree

  Rdiffusingprecomputedhashcodes  Laptopbackup(similartoBackupPC)

•  Archive  Jobskeptforever

  Par<<onedcatalog  Movecatalogdatatoanotherdatabase

•  ManagementConsole(perhapsbweb)  Controlofmul<pleDirectors

•  Writetomul<pleStoragedaemons

BaculaSystemsSA

Resources – Email lists

•  bacula‐users  Generalforumtoaskorrespondtoques<onsaboutBaculafrom

otherusers.•  Allusersareencouragedtosubscribeandpar<cipate

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐users

  Oncesubscribed,sendemailtotheBaculaUsersListat:•  bacula‐[email protected]

•  bacula‐devel  Forcommunica<ondirectlywithdevelopers

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐devel

  Emailaddress:bacula‐[email protected]

BaculaSystemsSA

Typical Open Source Resources

•  Bugsdatabase(hup://bugs.bacula.org)•  BaculaWiki(hup://wiki.bacula.org)•  BaculaEmailLists

  hup://www.bacula.org➯EmailLists

•  Recommended:bacula‐announce  Signupat:

hup://lists.sourceforge.net/lists/lis<nfo/bacula‐announce  Read‐onlylowvolumelistforuserswhowishtobeno<fiedof

importantevents(bugs,newreleases,...)

•  Foremailno<fica<onofnewpackagerelease  Signupat:hup://sourceforge.net/projects/bacula

•  ClickonDownload,thenMonitornexttodesiredpackage

BaculaSystemsSA

Resources – Email lists

•  Recommended:bacula‐bugs(No<fica<onaboutnewbugs)  hup://bugs.bacula.org

  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐bugs

•  bacula‐beta(No<fica<onofnewbetareleases)  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐beta

•  Bacula‐commits(diffofeachcommittotheSVN)  Normallyusedonlybydevelopers

•  Signupat:hup://lists.sourceforge.net/lists/lis<nfo/bacula‐commits

•  Archives(AvailableonSourceForge,andGmane)  hup://news.gmane.org/search.php?match=bacula

BaculaSystemsSA

Resources

•  Supportop<ons  Professionalsupport–fromBaculaSystemsorauthorizedpartners

  Otherprofessionalsupport

  Freesupport–fromtheBaculacommunity

•  BaculaSystemsSupport  Professionalsupportonafee‐paidbasis:

•  hup://www.baculasystems.com

•  BaculaCommunitySupport

•  Onanas‐availablebasis(users),byemail:  bacula‐[email protected]

BaculaSystemsSA

Bacula Systems Support

•  IfthecodeisfreewhydoIneedasupportcontract?  Insurancepolicyincaseofproblems

  Ticketsystem

  Guaranteedresponsetoques<onsandproblems

  Prioritybugfixing

  Fundeddevelopment

  Configura<onverifica<on

  Advancedinforma<onondevelopmentprojects

  Inputtodevelopmentprojectpriori<es

  DirectcontactwiththeBaculadevelopers

  BaculaEnterpriseEdi<onbinaries

BaculaSystemsSA

Thank You

Bacula Systems SA Rue Galilée 5

CH-1400 Yverdon-les-Bains

Switzerland T: +41 24 420 7890 F: +41 24 420 7891 E: [email protected] W: www.baculasystems.com

French Branch Office Bacula Systems S.A. 18 rue de l'Eglise FR-14440 Douvres La Délivrande France T: +33 (0) 231 97 33 78

German Branch Office Bacula Systems S.A. Sandstrasse 6 DE-49080 Osnabrück Germany T: +49 (0) 541 75 04 24 01

bacula systems sa

Documents