1© copyright 2011 emc corporation. all rights reserved. emc next-generation backup and recovery for...
TRANSCRIPT
1© Copyright 2011 EMC Corporation. All rights reserved.
EMC Next-Generation Backup and Recovery for OracleApollo AguilanEMC Backup Recovery Systems
2© Copyright 2011 EMC Corporation. All rights reserved.
Agenda• Problems many database administrators face
• Overview of Oracle Recovery Manager (RMAN) functional components
• Key features of EMC Data Domain deduplication storage systems
• Impact of Data Domain deduplication in an Oracle environment
• Customer Experience
• Summary
• Questions
3© Copyright 2011 EMC Corporation. All rights reserved.
Problems Many Database Administrators FaceToo many for this talk so we’ll focus on just backup and recovery• Non-stop growth and proliferation
• Backup windows remain approximately the same
• Recovery is just as important and often overlooked
• Limited online retention– Increased frequency of recovery for audits, troubleshooting,
updates, etc.
• Archive (aka, ILM) becoming increasingly important– Some data must be retained for 5 years, 7 years, forever….
7© Copyright 2011 EMC Corporation. All rights reserved.
RMAN – What Is It?• Oracle’s included backup /
recovery utility– Supports full, incremental, and image
backups– Retains backup information in the control file
and (optionally) a separate database catalog– Many configuration options to tailor to users’
requirements– Automatically eliminates unused data blocks
from most backups
For those in the audience that don’t already know:
8© Copyright 2011 EMC Corporation. All rights reserved.
Third Party Media Managers
Media Management Layer (MML) API
Backup
RMAN Repository (Control File)
Target Database
Flash Recovery Area (FRA)
RMAN Client
Disk
Backup
Recovery Catalog
Tape
Overview of RMAN Functional Components
9© Copyright 2011 EMC Corporation. All rights reserved.
Third Party Media Managers
MML API
Backup
RMAN Repository (Control File)
Target Database
FRA
RMAN Client
Disk
Backup
Recovery Catalog
Overview of RMAN Functional Components
10© Copyright 2011 EMC Corporation. All rights reserved.
Data Domain Deduplication Storage Systems
Data Domain
12© Copyright 2011 EMC Corporation. All rights reserved.
Performance: CPU-Centric versus Spindle-Bound
Thro
ughpu
t M
B/s
50
6,000
Number of Disk Spindles
50 100 150 200
Data Domain
Fibre Channel SATA
Mostdeduplication
vendors
13© Copyright 2011 EMC Corporation. All rights reserved.
Deduplication at Backup / Recovery Speeds
• 102,400 lookups/sec.: is it already in the multi-TB
store?
– 800 MB/sec, for 8KB segment: >100K lookups per second
– If random lookups: very slow
– Each disk: 1 MB/sec
• E.g. for a 7.2KB RPM Seagate 1TB SATA drive: <120
seeks/second
• 120/second @ 8KB segment: 0.96 MB/sec/disk
– Would need 830 disks to go 800 MB/sec (like most dedupers
today)
• This is 4 full height racks of nothing but SATA disks (16 drives /
3U rack)
Same performance, in less than half a full height rack
14© Copyright 2011 EMC Corporation. All rights reserved.
SISL Scaling Architecture
• Check uniqueness with Summary
Vector
• Check in-memory fingerprint cache
• Key resultsSee:
http://www.usenix.org/events/fast08/tech/full_papers/zhu/z
hu.pdf
• Data Domain answer: SISL™– Stream-informed Segment Layout
includes:• Summary Vector in RAM says if segment is
new• Segment Localities minimize seeks if answer
is on disk
15© Copyright 2011 EMC Corporation. All rights reserved.
Data Domain BasicsEasy integration with existing environment
Replication
CIFS, NFS, NDMP, DD
Boost
Ethernet
Virtual Tape Library (VTL)
over Fibre Channel
DD890 appliance
Control Tier Target Tier Disaster Recovery Tier
2U 2 to 10 ports 10 and 1 Gigabit Ethernet; 8 Gb/s Fibre Channel RAID 6 Up to 285 TB usable capacity with shelves 2 TB or 1 TB 7.2K rpm SATA hard disk drives in shelf File system NVRAM N+1 fans and redundant, hot-plug power supplies
DD890 appliance
Backup and archive
applicationsEMC
Symantec
CommVault
Tivoli Software
BakBone Software
Quest
17© Copyright 2011 EMC Corporation. All rights reserved.
EMC Data DomainRMAN disk-only backup and recovery strategies
ProductionDatabase
Dev/TestDatabases
DRDatabases
DR Restores can be performed manually or
automated via scripts
RMAN backups are performed natively via
NFS/CIFS
Data Domain Deduplication
Storage
Operational Restores can be leveraged for
Dev/Test environment refresh
RMAN backups are replicated automatically using minimal
bandwidth
Data Domain Deduplication
Storage
• Simplifies the backup process– RMAN disk-only backup
and recovery strategies are more straightforward
• Leverages Oracle Enterprise Manager– GUI for managing
backups, restore points, creating backup reports, etc
• Supports other Oracle backup capabilities– Incremental merge– Flash Recovery
18© Copyright 2011 EMC Corporation. All rights reserved.
“This is the format for a quote slide.”
Attribute
19© Copyright 2011 EMC Corporation. All rights reserved.
Second Friday Full Backup
B C D E F L G H
Data Deduplication: Technology OverviewStore more backups in a smaller footprint
A B C D E F G H I J
Friday Full Backup
A B C D A E F G
Mon Incremental A B H
Tues Incremental C B I
Thurs Incremental A C K
Weds Incremental E G J
Backup Estimated Data Logical Reduction Physical
Monday Incremental 100 GB 7–10x 10 GB
Tuesday Incremental 100 GB 7–10x 10 GB
K L
Wednesday Incremental 100 GB 7–10x 10 GB
Thursday Incremental 100 GB 7–10x 10 GB
Second FRIDAY FULL 1 TB 50–60x 18 GB
TOTAL 2.4 TB 7.8x 308 GB
FRIDAY FULL 1 TB 2–4x 250 GB
20© Copyright 2011 EMC Corporation. All rights reserved.
Data Integrity: Data Invulnerability Architecture
OtherRAID 6NVRAMSnapshots
End-to-end data verificationChecksumDeduplication, write to diskVerify
Self-healing file systemCleaningExpired dataDefragVerify
Deduplication
Local Compression
RAID
File System
GenerateChecksum
VerifyData Verify the file
system metadata integrity
Verify user data integrity
Verify stripe integrity
End-to-end data verification
21© Copyright 2011 EMC Corporation. All rights reserved.
Disk
1 TB
Disk
1 TB
Disk
1 TB
Weekly Full Backup – With Deduplication
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Weekly: Full image backups
Before: Without deduplication
22© Copyright 2011 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Weekly: Full image backups
Full
500 GB500 GB
After: With deduplication
Weekly Full Backup – With Deduplication
23© Copyright 2011 EMC Corporation. All rights reserved.
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> BACKUP AS COPY TAG ‘MAY9’ DATABASE INCLUDE CURRENT CONTROLFILE;RMAN> BACKUP ARCHIVELOGS TAG ‘MAY9’ ALL NOT BACKED UP DELETE ALL INPUT;
Target DB
1 TB
Deduplication applied to fulls requiring much less disk
Weekly: Full image backups
Full
500 GB500 GB
After: With deduplication
Weekly Full Backup – With Deduplication
24© Copyright 2011 EMC Corporation. All rights reserved.
Daily Incremental Backup – With Deduplication
Target DB
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;Run {
RECOVER COPY …BACKUP INCREMENTAL …
}
Daily: Incremental backup with update
500 GB Weekly Fulls
Incrementals after deduplication
25© Copyright 2011 EMC Corporation. All rights reserved.
Target DB
1 TB
RMAN> ALLOCATE CHANNEL CH1 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;RMAN> ALLOCATE CHANNEL CH2 DEVICE TYPE DISK FORMAT ‘/dd/backup/ora.weekly/%U’;Run {
RECOVER COPY …BACKUP INCREMENTAL …
}
Daily: Incremental backup with update
500 GB Weekly Fulls
Daily Incrementals
Incrementals after deduplication
Daily Incremental Backup – With Deduplication
26© Copyright 2011 EMC Corporation. All rights reserved.
Benefits of Using Inline Deduplication• Daily fulls instead of incrementals
• Longer online retention of full backup images
• No requirement for other backup software plug-ins
• Non disruptive introduction into RMAN process
• Simplified replication using EMC Data Domain Replicator Software
• Ideal location for Flashback Recovery Area
• Incrementally updated backups
27© Copyright 2011 EMC Corporation. All rights reserved.
Full
Sun Wed ThuMon Tue SatFri
DB Snap
Snap
Snap
Snap
Snap
Snap
Incremental MergeEMC Data Domain combines rapid cloning and deduplication
• Results in up-to-date nightly full images available for rapid recovery
Incremental
First image backup2X storage savings
• Nightly take cumulative incremental; apply to snapshot of weekly full
28© Copyright 2011 EMC Corporation. All rights reserved.
Alternatives Oracle Backup Options• RMAN to 3rd Party Backup Media
Management Layer (MML)/ Serial Backup Tape (SBT)– Makes random access disk look like streaming tape for VTL
support– Limits the options available to the DBA for backing up, cloning,
merging, etc.– RMAN communicates through MML to agent on 3rd party backup
application media server– Can front a Data Domain system as either disk-based backup or
VTL– All RMAN I/O is via MML which presents only a DEVICE TYPE TAPE
Data Domain Systems can work with an enterprise backup application but does not require it.
29© Copyright 2011 EMC Corporation. All rights reserved.
Data Domain Boost + RMAN = Next-Generation Backup and Recovery for Oracle
Data Domain
Oracle Database Administrator self-reliance
Superior Backup and Recovery Performance
Replication Policy Management Takes advantage of SBT integration using standard RMAN scripting tools for simple setup
30© Copyright 2011 EMC Corporation. All rights reserved.
Distributed Segment Processing Enabled– Distributes parts of deduplication workflow to SBT
plug-in on Oracle database server Anchors and fingerprints segments Checks with Data Domain system to find which
segments are new/unique Compresses and sends new segments only
– Avoids sending duplicate data to Data Domain system – Provides load balancing and link failover– Supported with single controller Data Domain
systems, Global Deduplication Array and DD Archiver
DD Boost for RMAN Distributed Segment Processing
31© Copyright 2011 EMC Corporation. All rights reserved.
DD Boost for RMAN – Optimized Replication
Managed, bandwidth optimized replication– Oracle server directs replication of individual backups using
RMAN– Data Domain system replicates only unique compressed
segments– Reduces workload on the Oracle server– Multiple topologies – one-to-one, bi-directional, one-to-many,
many-to-one, hierarchical– Encrypted optimized replication for security over WAN
transparent to Oracle servers
Start Replication
1
Oracle Database
CatalogLocal Data
Domain system
Secure Data Transfer
3 DoneCopy
2
Copy 1
Update Catalog
4 Copy 1
DR site Data Domain system
2Copy
2
32© Copyright 2011 EMC Corporation. All rights reserved.
Advanced Load Balancing and Link Failover
• Advanced Load Balancing & Link Failover– DD Boost level aggregation of multiple 1GbE or
10GbE links on Data Domain system• Backup/restore job load automatically distributed on
multiple ports on DD system
– Dynamic load balancing• DD Boost library negotiates with the Data Domain system
for an interface • Load distribution based on number of jobs on the interfaces
– Transparent failover of jobs• In-flight jobs on failed ports on DD system are transparently
moved over to healthy links
– Can be used in conjunction with network level / switch assisted aggregation
34© Copyright 2011 EMC Corporation. All rights reserved.
Data Domain Boost for RMAN - Demonstration
35© Copyright 2011 EMC Corporation. All rights reserved.
Summary• How deduplication benefits Oracle/RMAN backups
– More online retention– Less data to replicate– Allows the benefits of incremental update/merge backups using less disk
space
• Simplification– Minimal changes to the environment– DBA’s familiarity with NAS storage
• Savings– Less disk-based storage for longer retention– Reduce the cost of tape consumptions– Administrative cost– Less floor space
36© Copyright 2011 EMC Corporation. All rights reserved.
More Information…• For more information on EMC Data Domain
deduplication storage systems and Oracle, contact your EMC sales representative or visit
http://www.datadomain.com/solutions/oracle.html
37© Copyright 2011 EMC Corporation. All rights reserved.
Q&A
38© Copyright 2011 EMC Corporation. All rights reserved.
THANK YOU