open source data protection€¦ · open source data protection bareos open source data protection....

32
Open Source Data Protection Bareos Open Source Data Protection

Upload: others

Post on 03-Jul-2020

58 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Open Source DataProtection

Bareos ­ Open Source Data Protection

Page 2: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

What have we done in the last year?OpenHub (former Ohloh) analyses our code and has someinteresting numbers.see http://openhub.net/p/bareos

Page 3: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Project ActivityProject Activity Index (PAI) is High Activity 

Page 4: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Activity relation

More active than 98% of Open Hub Projects

Page 5: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Bareos 14.231.879 Lines added since 13.2

Page 6: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Bareos­WebUIWebfrontend for Bareos

Page 7: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Supported platforms addedUnivention Corporate ServerRHEL 7CentOS 7Ubuntu 14.04openSUSE 13.1customer request:RHEL4 (FD)Ubuntu 8.04 (FD)SLE_10 (FD)HP­UX (FD)

Page 8: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

General enhancementsTraymonitor now shows exclamation icon on errorAdded Python plugin apiFiledeamonStorage DaemonDirector

Class Abstraction for FD Python Plugin

Page 9: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Python plugin api:

/src/plugins/filed/python-fd.c

C­api plugin calls are translated to python calls and backaccess to:native python objectsdictionaries, listspython modules

Plugin functionality is implemented in pythonPython api can create job and debug messagesexamples in: https://github.com/bareos/bareos­contrib

Page 10: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Windows enhancementsACLs on windows config fileschangetime now detected by„GetFileInformationByHandleEx“ callACL changes were not detected

Support for Windows Deduplicated FilesystemWindows Encrypting Filesystem (EFS) supportFilesNotToBackup Registry Key support

Page 11: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

 *Standard Key that contains Files/Dirs not to Backup with

wildcards

Page 12: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

FilesNotToBackup Registry KeyContent of FilesNotToBackup Registry is automaticallyexcluded from BackupWin7 testVM already more than 500MBjoblog shows how many wildcards have been created: 

Page 13: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

All daemons ported towindows

Storage DaemonFilestorage onlytools ported: bextract, blsdisaster recovery on windows incl. ACLs

Directorpostgresql server backend only

Filedaemon was always availableInstaller supports setup of database and configurescatalogbackup

Page 14: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Windows InstallationFD, SD and Director can be selectedFirewall is opened as neededDebug Package also installs sourcecode

Page 15: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Windows InstallationNeeds installation of Postgresql firstscript does setup of database

Page 16: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Windows DaemonsDirector, Storage Daemon and Local Filestorage on

Windows   

 

Page 17: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

SD Tools

Page 18: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Storage Daemon Enhancementsautoinflation/deflation plugin:can compress and decompress streams on­the­flyoption to do compression on the sd instead fd

Support for tapealerts via sd pluginuse the same device,store alerts in database

Page 19: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

SD EnhancementsCollect Storage Daemon statisticsJobstatisticsDevice Statisticsboth are stored in Database

dynamic loading of storage backendsshared code between the different storage programs in anew shared library

Page 20: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Cloud Storage BackendsGluster FSCeph/RadosObject Storage (S3/Swift)Talk: Backup to and of the Cloud (Marco van Wieringen)

Page 21: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Blocksize and tape write speedBlocksizes impact on speed with compressible data: 

Page 22: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Blocksize and tape write speedBlocksizes do not hurt on uncompressable data: 

Page 23: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Blocksize setting in PoolYou want to use bigger blocksizes!Problem: Changing Blocksize in Device makes old BackupsunreadableTape Label is always written in given blocksize

Page 24: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Blocksize setting in PoolSolution:Blocksize is property of poolLabels are always written with default blocksizeData blocks are written with configured blocksize

Pool { Name = Pool-1M Pool Type = Backup Recycle = yes AutoPrune = yes Volume Retention = 3 months RecyclePool = Scratch Maximum Block Size = 1048576 # 1M }

Page 25: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer
Page 26: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer
Page 27: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

More info in tape tuning whitepaperFile Size also important 

Page 28: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Director EnhancementsClient and Schedule can be disabledAutochanger­sensitive commandse.g. status slots only can be run on autochanger

Exclude Dir Containing allows multiple entries

Page 29: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Director EnhancementsCopy/Migration Jobs:Client and Fileset not needed anymoreJobs show original values forclientlevelfileset

Disabled checking client concurrency

Page 30: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

What comes nextWindows Volume Shadow Service SupportVSS Writers are available for many applicationsStandard API that supportsFull, Incremental and Differential BackupsPartial files

When implemented, any Windows Application thatsupports VSS is automatically supported.Status: Full Backup and Restore run without errors.

Page 31: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

What comes nextVMware Vstorage API supportAllows backup of vmware virtual machinessupports Changed Block Trackingonly used/changed blocks are backed up/restored

Status: Backup and Restore work in lab environment

Page 32: Open Source Data Protection€¦ · Open Source Data Protection Bareos Open Source Data Protection. What have we done in the last year? OpenHub ... Ubuntu 14.04 openSUSE 13.1 customer

Thank you

Questions?

Philipp Storz, Bareos GmbH & Co. KG Open Source Backup Conference 2014