a step-by-step disaster recovery blueprint & best practices for your netbackup appliances &...
DESCRIPTION
In this technical session we will share a few customer tested blueprints for implementing DR strategies with NetBackup appliances showing support for onsite and offsite disaster recovery. This includes the architecture design with Symantec best practices, down to execution of the wizards and command lines needed to implement the solution. Watch the recording of this Google+ Hangout: http://bit.ly/13oTjvpTRANSCRIPT
1
A Step-By-Step Disaster Recovery Blueprint & Best Practices for Your NetBackup Appliances & Beyond (Onsite/Offsite)
A Step-By-Step Disaster Recovery Blueprint
Panel Members: • Dave Little, Distinguished Systems Engineer
• Ramin Arvand, Lead Principal Technical Architect
• Tim Burlowski, Sr. Product Manager, NBU Appliances
• Hai Nguyen, Sr. Product Manager , NBU Appliances
• Alex Sakaguchi, Product Marketing Manager
2 A Step-By-Step Disaster Recovery Blueprint
Submit your comments and questions:
• Via Twitter using the hashtag:
• Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 3
#SYMCHangout
http://bit.ly/13oTjvp
Goals & Objectives
A Step-By-Step Disaster Recovery Blueprint 4
1- Help you establish a stronger last line of defense for 52X0 appliances DR procedures.
2- Define, what is possible, what is not possible and where to go for more help when it comes to a 52X0 series appliance disaster recovery procedures.
3- Recovery procedures from OST disk devices are all the same with a minor NBU command option difference.
Storage Life Cycle Policy (SLP)/Optimized Duplication
A Step-By-Step Disaster Recovery Blueprint 5
NBU Master
Domain A
NBU Media
Server
Open Storage
Device
Image
Backup
Duplication
Image
OpenStorage
device
Image
OST Optimized
Duplication
With OpenStorage, NetBackup sees disk as disk and
knows about the advanced capabilities
NetBackup OpenStorage provides
tighter integration,
richer features, better solution
AIR Under Hood Diagram
A Step-By-Step Disaster Recovery Blueprint 6
10GB E Network10GB E Network
Production Data Center
Disaster Recovery Data Center
Colorado DC
NetBackup MasterDR NetBackup Master
OPS Center
Netbackup
Lan ClientsNetbackup
Lan Clients
A.I.R
Image
Image
Image
Image
Netbackup 5220 Appliance
Media/Storage Server
Cloud GW
Netbackup 5220 Appliance
Media/Storage Server
Cloud GW
DR Netbackup 5220
Appliance
Media/Storage Server
Cloud GW
Copy 1 Copy 2
Alabama DC
OST image replication
(OST Optimized
Duplication)
NetBackup Storage
Lifecycle Polices control
the replication from
Alabama Domain to
Colorado Domain and
once the image is
automatically imported by
Policy, the Colorado
Domain copy is managed
by that domain
AIR “Import” is
a) Immediate
and
b) Optimized
(fast) operation
Which one to use? AIR or Opt Dup
A Step-By-Step Disaster Recovery Blueprint 7
1- When it comes to protecting NB clients data, configure A.I.R across your
sites.
2- When it comes to protecting NB catalog of a Master appliance, configure optimized duplication across your sites.
3- When it comes to protecting 52X0 appliances configured as media servers, no NetBackup catalog recovery is required on the Media server appliances during DR.
Media Server DR Scenarios
A Step-By-Step Disaster Recovery Blueprint 8
Storage Layout & Troubleshooting
5220
controller RAID
PORT 1 8 4 2
8 4 2 PORT 2
8G
FC
PORT 1 8 4 2
8 4 2 PORT 2
8G
FC
PORT 1 8 4 2
8 4 2 PORT 2
8G
FC
PORT 1 8 4 2
8 4 2 PORT 2
8G
FC
8G
FC
GRN
10G
ACT
/LIN
K A
GRN
10G
ACT
/LIN
K B
10
G
NIC
GRN
10G
ACT
/LIN
K A
GRN
10G
ACT
/LIN
K B
5230
NetBackup 5220 NetBackup 5230
Same storage capacity options
8 CPU cores “Westmere” 12 CPU cores “Sandy Bridge”
48/96 GB RAM 64/128 GB RAM
4 PCIe 2.0 slots 5 PCIe 3.0 slots
Broader I/O configuration
Data RAID 6 Hot Swappable
Data RAID 6 Hot Swappable
OS RAID 1 OS RAID 1 Hot Swappable
LI-ON RAID Write Cache protection
Super Cap/NVRAM RAID Write Cache protection
Submit your comments and questions:
• Via Twitter using the hashtag:
• Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 9
#SYMCHangout
http://bit.ly/13oTjvp
Master appliance Recovery at Production Site
A Step-By-Step Disaster Recovery Blueprint 10
Customer Environment Note1: Appliance
setup so that the Hot-Catalog backups are
written to an Appliance Storage Server
device and then the image is duplicated to
DR remote location via an SLP
configuration.
How To Read NB Catalog DR File
A Step-By-Step Disaster Recovery Blueprint 11
DR_MEDIA_REC 2 0 0 nb5220dc 2 1 0 0 0 0 0 0 6 35 0 1353982384 @aaaak 1;PureDisk;NB5020DR;NB5020DRDP;PureDiskVolume;0 *
The names of the storage server and disk
pool that will be created in next steps need
to match the production environment. If
there are any questions of what these
names were the DR file can be used to
identify those names.
From this DR file the following items are pointed out:
Storage server type = PureDisk
Storage Server name = NB5020DR
Disk pool name = NB5020DRDP
Procedures for Master Appliance Server Recovery At Local Production Site (Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 12
1) Configure the role of Master Appliance 2) Configure the role of Recovery Media Server 3) Configure Recovery Storage Server 4) Configure a Disk Pool on Recovery Storage Server 5) Configure a DSTU 6) Run nbcatsync to synchronize DR file 7) Tune NetBackup for faster recovery (Buffer Files) 8) Run bprecover
Glossary
Recovery Media Server = 5220 Appliance that holds Catalog backup
Recovery Storage Server = 5220 Appliance that holds Catalog backup
FQDN = Fully Qualified Domain Name
nbcatsync = Reconciles the disk media ID information held in the meta-data of the NetBackup
image database with the disk media ID information found in the NetBackup EMM database.
bprecover = Recovers selected NetBackup related catalogs
Procedures for Master Appliance Server Recovery at Local Production Site
A Step-By-Step Disaster Recovery Blueprint 13
1. Configure the role of Master Appliance using CLISH Login to the appliance as admin and run the following command Main_Menu>Appliance>Master
2. Configure the role of Recovery Media Server using CLISH Login to the master server appliance and run the following command: Main_Menu>Appliance>Add <media server appliance name>
The above command will add the media server appliance as SERVER in bp.conf file & performs below EMM command on the master server nbemmcmd -addhost -machinename XXX -machinetype media -masterserver XXX -netbackupversion 7.5.0.4 -operatingsystem linux http://www.symantec.com/docs/TECH163230 is available for more information.
A Step-By-Step Disaster Recovery Blueprint 14
3. Configure Recovery Storage Server (using the same name as in production)
Procedures for Master Appliance Server Recovery At Local Production Site
NB CLI ‘s - NB appliances
nbdevconfig -creatests --storage_server nb5220 -stype PureDisk -media_server nb5220
tpconfig -add -stype PureDisk -storage_server abc-01 -sts_user_id root -password root
For 3rd party OST, make sure OST plug-in has been installed and configured
nbdevconfig -creatests -st 9 -storage_server SSS -stype DataDomain -media_server XXX tpconfig -add -storage_server SSS -stype DataDomain -sts_user_id boostuser -password cccc
A Step-By-Step Disaster Recovery Blueprint 15
4. Create the Disk Pool on Recovery Storage Server (using the disk pool wizard and the same name as in production)
Procedures for Master Appliance Server Recovery At Local Production Site
5. Configure DSTU
16
6. Run nbcatsync to synchronize the disaster recovery file to the new disk pool
Procedures for Master Appliance Server Recovery At Local Production Site
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1
A Step-By-Step Disaster Recovery Blueprint
17
6. Run nbcatsync to synchronize the disaster recovery file to the new disk pool
Procedures for Master Appliance Server Recovery At Local Production Site
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 1
A Step-By-Step Disaster Recovery Blueprint
A Step-By-Step Disaster Recovery Blueprint 18
Procedures for Master Appliance Server Recovery At Local Production Site
7. Tune NetBackup for faster recovery
These touch files will be in /usr/openv/netbackup/db/config
echo 262144 > SIZE_DATA_BUFFERS
echo 256 > NUMBER_DATA_BUFFERS
echo 1048576 > SIZE_DATA_BUFFERS_DISK
echo 512 > NUMBER_DATA_BUFFERS_DISK
For more information, please study
“Symantec NetBackup™ Backup Planning and Performance Tuning Guide”
A Step-By-Step Disaster Recovery Blueprint 19
8. Run bprecover
Procedures for Master Appliance Server Recovery At Local Production Site
NB CLI: /usr/openv/netbackup/bin/admincmd/bprecover –wizard
A Step-By-Step Disaster Recovery Blueprint 20
Standby NB DR Master
other physical clients
Copy 2
DR Copy
NB Primary Master
Copy 1
Procedures for Master appliance Recovery at
Remote site
Procedures for Master appliance Server Recovery At Remote DR site (Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 21
1) Configure the role of Master Appliance 2) Configure the role of Recovery Media Server 3) Configure Recovery Storage Server 4) Configure a Disk Pool on Recovery Storage Server 5) Configure a DSTU 6) Run nbcatsync to synchronize DR file * 7) Tune NetBackup for faster recovery (Buffer Files) 8) Run bprecover
Procedures for Master Appliance Server Recovery At Remote DR site (Applicable for Any OpenStorage Target)
A Step-By-Step Disaster Recovery Blueprint 22
6. Run nbcatsync to synchronize the disaster recovery file to the new disk pool
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 2 –dryrun
nbcatsync -sync_dr_file /tmp/DR/NBU_Catalog_1358360205_FULL -copy 2
SLP/AIR Reporting: OpsCenter SLP Inflow/Outflow Trend Report
23
Must monitor to ensure that the Green line
isn’t growing faster than the red line. In this
case, duplications are falling behind
Submit your comments and questions:
• Via Twitter using the hashtag:
• Via the Google+ Event page:
A Step-By-Step Disaster Recovery Blueprint 24
#SYMCHangout
http://bit.ly/13oTjvp
NetBackup Appliances DR Best Practices
25
Document All Appliance Recovery Procedures (Site Specific Step–By–Step)
Re-visit Recovery Point Objectives (RPOs) and Recovery Time Objectives
(RTOs) to ensure recovery per real business requirements
OpsCenter is your friend. Use it to monitor progress of SLPs.
Configure IPMI
Enable Call Home
Store NB Catalog DR File Off-Site
Create Checkpoint Before Applying Maintenance Patches
A Step-By-Step Disaster Recovery Blueprint
26
In the past disaster recovery could be overwhelming, but with the current capabilities of NetBackup and our appliances, this has been greatly simplified.
Call to Action – Document and test your Disaster Recovery Plan!
A Step-By-Step Disaster Recovery Blueprint
Upcoming Virtual Vision Sessions
Date Sessions [Wed. @ 9:30 am Pacific Time]
7/24/2013 Managing Dark Data and File Governance
7/31/2013 The New Era of Business Continuity
8/7/2013 BONUS SESSION: Backing up vCloud Director | What's the difference between the vCD API and VADP?
8/14/2013 What Can the Backup Exec 3600 do to Improve your Data Protection Strategy?
8/21/2013 Why Host-Based SSDs are Critical for SLAs in Mission-Critical Datacenters
8/28/2013 Less Work, More Flow: Revolutionizing Governance and eDiscovery Workflow
9/4/2013 On Prem vs. Cloud Archiving
http://www.symantec.com/connect/blogs/virtual-vision-join-conversation
A Step-By-Step Disaster Recovery Blueprint 27
Thank you!
Copyright © 2012 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
Google+ Hangout:- A Step-By-Step Disaster Recovery 28
Dave Little NetBackup Strategist
Ramin Arvand Principal Technical Architect