scott joseph emc brs manager

38
1 Backup Recovery Systems New Architectures for Improving Performance, Reliability and Driving down Operational Costs Scott Joseph EMC BRS Manager

Upload: elisha

Post on 17-Mar-2016

38 views

Category:

Documents


0 download

DESCRIPTION

Backup Recovery Systems New Architectures for Improving Performance, Reliability and Driving down Operational Costs. Scott Joseph EMC BRS Manager. Topics of Discussion. Customer Challenges and Market Update EMC Backup Recovery Systems (BRS) Data De-duplication Next Steps. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Scott Joseph EMC BRS Manager

1

Backup Recovery SystemsNew Architectures for Improving Performance, Reliability and Driving down Operational Costs

Scott JosephEMC BRS Manager

Page 2: Scott Joseph EMC BRS Manager

2

Topics of Discussion

Customer Challenges and Market Update

EMC Backup Recovery Systems (BRS)

Data De-duplication

Next Steps

Page 3: Scott Joseph EMC BRS Manager

3

Optimization Technologies Take Center Stage

Network WANOptimization

Optimization

Server VirtualizationServer Optimization

DeduplicationOptimizationStorage

Page 4: Scott Joseph EMC BRS Manager

4

Regulatory Issues Requirements to .keep more .information longer

E-discovery for .litigation

Fines for non-.compliance

Common Challenges with Backup Environments

4

Security Issues Mishandling .customer records

Losing off-site .copies of data

Media and Business Issues Meeting backup windows Meeting recovery SLAs Reliability, Performance Management overhead Overall cost Timely restores; Failed restores Backup jobs running into .production periods

Inability to back up remote .offices

Virtual machines and Virtual Data Centers pose unique backup challenges

Information Growth!

Page 5: Scott Joseph EMC BRS Manager

5

When Faced With These Issues…Where Has IT Ended Up?

                                                   

Typical answers:

Purchase more cartridges

Purchase more tape drives

Purchase more tape libraries

Page 6: Scott Joseph EMC BRS Manager

6

Data Protection Market Has Been Dominated by Tape in the past

6

ApplicationEnvironment

PrimaryStorage

Backup and Replication

Software

OnsiteProtection

Offsite DisasterRecovery / Storage

Transportation

► 50-year old technology

► Large market: $4.7bn

Page 7: Scott Joseph EMC BRS Manager

7

Costvs

SLAs

Traditional Tradeoff - Tape vs Disk

Cheap Easy Inertia Well understood It’s the way we’ve always done it Good enough Portable

Expensive More than we need Not Portable Difficult to manage Not how we do it

Page 8: Scott Joseph EMC BRS Manager

8

Tipping Point to Move to Disk

Costvs

SLAs

Meets Regulatory and Compliance Requirements

Lower-cost bandwidth Low-cost hard drives Improves organizational and

opperational efficiencies Disk libraries offer benefits

without process change “Smarter” backup

applications that understand disk

Unreliable Not secure Slow No leverage of information

beyond storage

Page 9: Scott Joseph EMC BRS Manager

9

Hitting the Wall…

050

100150200250

Devices &mediaTapeautomation

E.G. Quantum + ADIC Tape Revenues Q4-06 – Q3-09

$M

Down58%

Page 10: Scott Joseph EMC BRS Manager

10

Confidential10

It’s an Ongoing Trend…

Page 11: Scott Joseph EMC BRS Manager

11

Backup Storage Technology “waves”

1990s 2000s 2010s

TapeAutomation

VTLs

Integrated DedupeSystems & Software

Bac

kup

Syst

ems

Mar

ket

Page 12: Scott Joseph EMC BRS Manager

12

Backup/Recovery Architectures Evolution

Backup/Recovery Architecture

on premise off premise

Conventional(Tape-centric)

Transformational(Dedupe-centric)

Backup/MediaManager

Onsite Backup Storage

Disaster RecoveryStorage

Application BackupClients

Deduplication backup software and system

Backup Software VTL VTL/Tape

VM

Backup Software Tape Tape

Deduplication storageBackup Software

Page 13: Scott Joseph EMC BRS Manager

13

Data Growth– While production will grow 5x, backup typically

represents a factor of 30x production capacity

– Daily, weekly, and monthly full backups kept for months or years

Server Virtualization– VM sprawl creates protection challenges

– Server consolidation creates high server utilization leaving little bandwidth for backup; conventional backups typically move 200% of the data each week

Next Generation Virtual Data Center– The introduction of Cloud Computing, with “IT as

a Service” models, drives greater availability and resource flexibility

– Demands lower backup windows and RTO/RPO

Digital Information Created and Replicated Worldwide

2,500

2,000

1,500

1,000

500

0

Exa

byte

s

20122011201020092008Source: IDC Digital Universe white paper, sponsored by EMC, May 2009

5-FOLD Growth

in 4 YEARS

VirtualServer

A

Virtual Server

B

Virtual Server

C

Old ParadigmPhysical Environment: Low overall

server utilization and plenty of bandwidth for backup

New ParadigmVirtual Environment: High overall

server utilization and little bandwidth for backup

20 percent resource utilization 80 percent resource utilization

100%

80%

40%

0%

60%

20%

CPU

Util

izat

ion100%

80%

40%

0%

60%

20%

CPU

Util

izat

ion

ServerA

ServerB

ServerC

ESXServerHardware

Shared Physical Resources

Major trends influencing the transformation of backup environments

Why So Much Interest in Data De-dupe?

Page 14: Scott Joseph EMC BRS Manager

14

Backup/Recovery: Hot Spot in the Enterprise

• Secular shift from tape-centric to disk/network-centric approaches

• Enabler: massive data deduplication and compression techniques

• Unabating growth of enterprise data overwhelms legacy infrastructure

• Server virtualization another catalyst

What are your top storage initiatives?

Page 15: Scott Joseph EMC BRS Manager

15

Data De-duplication is Transformational

Market implications: “Gartner views this technology as transformational because it radically decreases the economics of disk-based backup and recovery.”

“…too compelling to ignore.”

Source: Dave Russell, Gartner

“By 2012, deduplication will be applied to

75% of all backups.”

Insights from Gartner

“Production deployments of deduplication for backups have progressed at an unusually high rate for such a recent technology.”

Recommendations:

“…ensure that your organization is comfortable with the robustness and maturity of the vendor's approach.”

Page 16: Scott Joseph EMC BRS Manager

16

EMC Backup Recovery Systems (BRS): A Newly Formed EMC Division

1,800 employees 10 R&D locations Data protection storage systems

> 50,000 systems installed> 13,000 PB under protection WW

Global sales/support/services ~ 40,000 customers

200820072006

Total Revenue ($B)

$0.6

$0.8

$1.1

2009

$1.5

Page 17: Scott Joseph EMC BRS Manager

17

BRS Market Position

Avamar • #1 de-duplication backup software worldwide• > 4,500 installations• > 2,500 customers

Data Domain • #1 deduplication storage worldwide• > 9,500 installations• > 3,500 customers

Disk Library • #1 VTL worldwide• > $1B Sales

NetWorker • Top three enterprise backup applications• > 30,000 customers

Page 18: Scott Joseph EMC BRS Manager

18

EMC Position in Backup/RecoveryDe-duplication in the F1000

TheInfoPro Wave 12 Storage Study, Spring 2009

0% 10% 20% 30% 40% 50%

Dell

HP

Syncsort

Asigra

COPAN

Microsoft

Oracle

Quantum

CommVault

FalconStor

Symantec

IBM

NetApp

EMC/Data Domain

In Use NowIn Pilot/EvaluationIn Near-term Plan (Through Q2 '09)In Long-term Plan (Q3 '09 – Q1 '10)

• Backup re-design is hot

• Market penetration still low

• EMC has a strong leadership position and best-in-breed technologies

Page 19: Scott Joseph EMC BRS Manager

19EMC Corporation Variable Length

Device Side

HashingSingle Instancing

Fixed Length Client Side

Data Reduction

Redundant Data Elimination

CommonalityFactoring

Data De-Duplication

De-Mystifying Data Deduplication…

Page 20: Scott Joseph EMC BRS Manager

20EMC Corporation

EMC’s Definition of De-Duplication

“The process of detecting and identifying the unique ‘chunks’ within a given set of data, eliminating redundancy when stored or moved.”

• Uses data identification & comparison algorithms along with content addressing and indexing• Unique “chunks” are easily reconstituted to original format from the de-duplicated state

Algorithm

Before: “chunks” = 39

Data Group 1

Data Group 2

Data Group 3

After: Unique “chunks” = 6

Page 21: Scott Joseph EMC BRS Manager

21EMC Corporation

EMC Differentiation – Less is More

EMC Data deduplication significantly reduces:Power, Cooling, Management, Complexity

Net: The less storage needed for dedup, the bigger savings on storage.The smaller the storage footprint, the bigger the savings on bandwidth

100TB lives on 50TB

100TB lives on 33TB

100TB lives on 25TB

100TB lives on 5TB

100TB lives on 100TB

Page 22: Scott Joseph EMC BRS Manager

22EMC CONFIDENTIAL—INTERNAL USE ONLY

Factors Impacting De-dupe Ratios for Backup

Type of data

Small variations can have large impact

Data change rate

More user created content =

higher de-dupe ratio

Less change = higher de-dupe ratio

Retention policyLonger retention

policy = higher de-dupe ratio

More full backups = higher de-dupe ratio

Full to incremental backup ratio

Page 23: Scott Joseph EMC BRS Manager

23EMC CONFIDENTIAL—INTERNAL USE ONLY

Data TypeAmount of

Primary DataProtected

Amount of Data Moved

Daily

Windows file systems 3,573 GB 6 GB

Mix of Windows, Linux, and UNIX file systems 5,097 GB 11 GB

Engineering files on NAS (NDMP backups) 3,265 GB 24 GB

Mix of 20 percent databases, 80 percentfile systems (Windows and UNIX) 9,583 GB 80 GB

Mix of Linux file systems and databases 7,831 GB 104 GB

Source: EMC

While results will vary by data type and mix, Avamar can dramatically improve backup performance and efficiency

Real World ResultsDaily full backups vs. traditional daily full backups

Page 24: Scott Joseph EMC BRS Manager

24

Retain more

Replicate smarter

Recover reliably

Efficiently move data offsite – faster Only move deduplicated data for 99% bandwidth efficiency and cost-effective DR

Leverage end-to-end data verification Continuous fault-detection and healing ensure data recoverability to meet SLAs

Retain backups longer, using less disk 10-30x data reduction eliminates the use of tape for operational recovery

Introduce Common De-dupe Values

Page 25: Scott Joseph EMC BRS Manager

25

Retain. Replicate. Recover.

De-dupe everything without changing anything Never backup the same data twice

Simplify backup, archiving and DR with easy integration across workloads, infrastructures, and backup software

Revolutionize your backup by moving less data to solve your toughest VMware, NAS, and remote office backup challenges

Data Domain de-duplication Storage SystemsAvamar de-duplication Backup Software

Differentiate storage system vs. backup software values

Page 26: Scott Joseph EMC BRS Manager

26

Data Domain BasicsEasy integration with existing environment

Replication

DD630 Appliance

Control Tier

Target Tier DR Tier

DD630 Appliance

Backup & Archive Application Agnostic

CIFS, NFS, NDMP, OpenStorage

Ethernet

VTL over FC(not available on DD140)

Page 27: Scott Joseph EMC BRS Manager

27

Industry’s Most Scalable Inline Deduplication Systems

DD140 DD610 DD630 DD670 DD880 GDA DDX Array

Speed (Other) 450 GB/hr 675 GB/hr 1.1 TB/hr 3.6 TB/hr 5.4 TB/hr 86.4. TB/hr

Speed (DD Boost) 490 GB/hr 1.3 TB/hr 2.1 TB/hr 5.4 TB/hr 8.8 TB/hr 12.8 TB/hr 140 TB/hr

Logical Capacity 17-43 TB 75-195 TB 165-420 TB 1.1-2.7 PB 2.8-7.1 PB 5.7-14 .2 PB 45.6-114 PB

Raw Capacity 1.5 TB Up to 6 TB Up to 12 TB Up to 76 TB Up to 192 TB Up to 384 TB Up to 3.07 PB

Usable Capacity 0.86 TB Up to 3.98 TB Up to 8.4 TB Up to 55.9 TB Up to 142.5 TB Up to 285 TB Up to 2.28 PB

DDX Array SeriesSoftware Options:DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock and DD Encryption

Up to 16 ControllersDD140 Remote Office Appliance

DD600 Appliance Series

DD880

Global Deduplication Array

Page 28: Scott Joseph EMC BRS Manager

28EMC Corporation

Introducing EMC Avamar

Reduces the size of backup data at the source—before it is transferred across the network—reducing backup times by up to 10 times

Reduces required network bandwidth—and the amount of data backed up daily—by up to 500 times

De-duplicates across sites and servers for maximum efficiency

Cost-effectively stores a greater number of full backups on disk—reducing or eliminating the need for tape

Ideal for protecting remote offices, VMware environments, LAN servers in the data center—enabling fast, reliable, and secure backups over existing network connections

Revolutionizes Backup with Global, Source Data De-duplication

28

Page 29: Scott Joseph EMC BRS Manager

29

Avamar out-of-the-Box Functionality

Page 30: Scott Joseph EMC BRS Manager

30EMC Corporation

Avamar Data Store or Avamar server

Avamar - How it Works

Global Data De-duplication Instances

Client agent scans the data for changes

Modified files broken into sub-file variable length segments

Only unique sub-file segments are backed up

Queries local file cache to identify and disregard static files

Compresses and applies a hash to each object

Queries local hash cache, and then the Avamar server to determine if objects are unique

Page 31: Scott Joseph EMC BRS Manager

32EMC Corporation

Complete EMC backup and recovery product• Avamar Data Store

– Avamar backup and recovery software with integrated de-duplication

– EMC-certified hardware—fully configured and delivered– 4 TB to 32 TB de-duplicated backup capacity– Equivalent of up to 1.1 PB of cumulative traditional disk or

tape backup storage* – Backup media requirement reduced 20–40 times

• Built-in high availability– Avamar RAIN technology– Spare node, RAID– Redundant power distribution– Daily integrity checks

* Equivalent traditional backup capacity assumptions: 100 percent Microsoft Office file data, weekly full and daily incremental backups, no compression, 10 percent daily change rate, 90-day retention

Avamar Data Store

Avamar Flexible Deployment

WAN

(ENCRYPTED)

(ENCRYPTED)

Avamar Software Agent

SMALL REMOTE SITE

Avamar agent onlyon primary systems

DATA CENTER

Primary systems

Avamar Data StoreREMOTE RECOVERY SITE

Primary systems

Avamar Data Store

LARGE REMOTE SITE

Primary systems

Avamar Data Store

Multi-node configuration

(ENCRYPTED)(ENCRYPTED)• Avamar Data Store Single Node

– 1 TB and 2 TB de-duplicated backup capacity– Equivalent of up to 70 TB of cumulative traditional disk or

tape backup storage*– Designed for easy deployment at remote offices– Offers fast, local recovery without dependence on a WAN

connection

Page 32: Scott Joseph EMC BRS Manager

33EMC Corporation

Up to 95 percent reduction in data moved

Up to 90 percent reduction in backup times

Up to 50 percent reduction in disk impact

Up to 95 percent reduction in NIC usage

Up to 80 percent reduction in CPU usage

Up to 50 percent reduction in memory usage

All backups are stored as “virtual full backups,” ready for immediate restore

Maintains effective consolidation ratios without overtaxing CPU utilization

Optimized Backup for VMware Infrastructure

Avamar Efficiently Protects Virtual Machines

x86 Architecture

VMware Virtualization Layer

Traditional moves ~200% weekly

Avamar moves ~2% weekly

x86 Architecture

VMware Virtualization Layer

DiskNICMemoryCPU

Application

Operating System

Application

Operating System

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

DiskNICMemoryCPU

Page 33: Scott Joseph EMC BRS Manager

34EMC Corporation

Avamar Desktop/Laptop

End-user initiated restore

Windows or Mac OS X

Avamar Desktop/Laptop

Puts power in end-users hands• Eliminates Help Desk for restoring

data to desktop or laptop• End-users restore their data anytime, anywhere• Self-managed restores• Document-level search engine

All the benefits of Avamar backup• Data deduplicated at the source• Up to 10 times faster daily full backups• Minimal impact on PC and network resources during

backup

Page 34: Scott Joseph EMC BRS Manager

35

Weekly BRS Customer Webcasts- Data Domain, Avamar, NW, DPA

Webcast details for Data Domain, DPA, NW and Avamar (2) sessions: WebEx URL:  https://mman.webex.com/mman/j.php?ED=90785562&UID=0 WebEx password:  emcdemo Dial-in:  888-643-3085, Passcode: press 1, then 28838618# Webcast details for Fri. Avamar (1) session only: LiveMeeting URL: https://www.mymeetings.com/nc/join/ LiveMeeting Conference number: RG4548207, Passcode: INTEGRITY Dial-in: 866-617-1526, Passcode: INTEGRITY

Day/Times MON TUES WED THUR FRI

8:00 - 9:30 a.m. (pacific time) NetWorker Data Domain Avamar (1) 

10:00 - 11:30 a.m. (pacific

time)Data Protection

Advisor

1:00 - 2:30 p.m. (pacific time) Avamar (2)

Page 35: Scott Joseph EMC BRS Manager

36

Why EMC and Par4

Data Domain and Avamar Solutions are Designed for Deduplication– Minimize media server requirements– Minimize storage requirements– Fastest time to recover– Fastest time to replicate

Its easy and it works– Data Domain plugs into existing infrastuctures, minimal change required– Avamar is a complete solution, with easy to functionality– Very high “Net Promoter” scores with customers

Proven technology– 6th and 7th generation of technology– Deduplication products on the market since 2003

Par4 can customize the solution to fit your needs– Services and support staff worldwide– Broad portfolio

Page 36: Scott Joseph EMC BRS Manager

37

Customer Tape Environment Before…

Page 37: Scott Joseph EMC BRS Manager

38

Same Environment After Data Deduplication

Page 38: Scott Joseph EMC BRS Manager

39

BRS^