Virtualization Of The Storage Infrastructure
Amir BiranRegional Technical Partner AdvisoreMed & Africa
© 2008 NetApp. All rights reserved.
2
19931993 NAS appliance and Snapshots
Near-line storage appliance20012001
Multiprotocol appliance19961996
20022002 Unified SAN/NAS appliance
20032003 iSCSI storage system
20042004 RAID-DP™ disk resiliency
20052005 Thin provisioning and virtual cloning
20062006 Scalable grid storage
20072007 De-Duplication
Innovating to Deliver New Choices
© 2008 NetApp. All rights reserved. 3
Simplifying Data Management
Network Appliance brings
unmatched simplicity
to the complex world of
enterprise data management.
• Reduce cost & complexity
• Minimize risk
• Control change
© 2008 NetApp. All rights reserved.
Gartner Midrange Enterprise Magic Quadrant
Source: Gartner, Inc. Nov 2008Roger W. Cox, Pushan Rinnen, Stanley Zaffos
Magic Quadrant for Midrange Enterprise Disk Arrays
This Magic Quadrant was published as part of a larger research note and should be evaluated in the context of the entire report. The report is available upon request from NetApp.
The Magic Quadrant is copyrighted Nov 12, 2008 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
© 2008 NetApp. All rights reserved.
Source: Gartner, Inc. March 2008Pushan Rinnen, Robert E. Passmore, Roger W. Cox,
Magic Quadrant for Midrange and High-End NAS Solutions, 1H08
This Magic Quadrant was published as part of a larger research note and should be evaluated in the context of the entire report. The report is available upon request from NetApp.
The Magic Quadrant is copyrighted March 5, 2008 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
As of March 2008
challengers leaders
niche players visionaries
completeness of vision
abili
ty t
o e
xecu
te
NetApp
EMC
IBM
Hitachi/Hitachi Data Systems Isilon Systems
BlueArcHP
Ibrix
ONStorePanasas
SGI
Sun Microsystems
Pillar Data SystemsExanet
Recognized Industry Technology Leadership Gartner Magic Quadrant for NAS
© 2008 NetApp. All rights reserved.
What If You Could . . .
Backup and restore your VMs instantaneously
Easily protect all your virtualized data with DR
Save 50% on your storage, power, cooling, and space
Deduplicate virtual server and virtual desktop data, enabling 50% space savings, or more
Automate your most labor-intensive data management tasks
Clone and provision storage as quickly as your VMs
Do all of this with one architecture in any environment
© 2008 NetApp. All rights reserved. 7
The Functional-Silo Storage Model
iSCSIFibreChannel
Departmental
NASEnterprise
SANDepartmental
SANEnterprise
NAS
LANEthernet
Cost Complexity Access
© 2008 NetApp. All rights reserved. 8
The NetApp Model: Unified Storage
DepartmentalEnterprise Enterprise
SAN NASDepartmental
Unified Storage
LANiSCSIFibreChannel Ethernet
© 2008 NetApp. All rights reserved.
Fabric Attached Storage (FAS) Systems
FAS2050
99TB104 drivesFC, SAS& SATA
FAS2020
65TB68 drivesFC , SAS & SATA
FAS6040
840TB840 drivesFC & SATA
FAS6080
1176TB1,176 drivesFC & SATA
FAS3140
420TB420 drivesFC & SATA
840TB840 drivesFC & SATA
FAS3170
FAS3160
672TB672 drivesFC & SATA
Enterprise level Features and Functionality across all models One O/S, One Admin Interface Seamless Scalability No Data Migration Total interoperability
Data ONTAP + One Family of Management Software
© 2008 NetApp. All rights reserved.
Standard Solutions
10
Most storage solutions – HARD link between physical disk cylinders and LUNs
ExchangeExchange
Disk Sectors
OracleOracle
Allocate SPECIFIC
Sectors
© 2008 NetApp. All rights reserved.
NetApp’s Approach – Virtualize Data Layout
11
Total abstraction of logical filesystems from physical disks
MailMail
BillingBilling
OracleOracle
SMSSMS
Each volume utilizes ALL disks – great performance for all volumes
Each additional disk improves performance of ALL volumes
© 2008 NetApp. All rights reserved.
FlexVol™ Volumes: Improving Space Utilization
12
Vol 1 Vol 2 Vol 3 Vol 4
Vol 1
Vol 2
Vol 3
Vol 4
Free
© 2008 NetApp. All rights reserved.
FlexVol™ Volumes: Increasing I/O Performance
13
Regular volumes Volume performance
limited by number of disks it has
“Hot” volumes can’t be helped by disks on other volumes
FlexVol volumes Spindle sharing makes
total aggregate performance available to all volumes
© 2008 NetApp. All rights reserved.
The new RAID issue
Disk drives are very big (1.5 TB).Reconstruct of failed, large, disk can take over
36 hours.Any media error on another disk during
reconstruct will cause a data loss.Adding disks to existing RAID group should not
put data in risk.
Traditional RAID types (like RAID/5) are not acceptable anymore
© 2008 NetApp. All rights reserved.
OK
NOTData Lost
Solution?
Mirroring
Is mirroringthe right solution?
Problems With Traditional RAID
© 2008 NetApp. All rights reserved.
RAID-DP: High Performance RAID-6
2,000 to 40,000 times more secure than regular RAID
More reliable than mirroring for double-disk failure
14% Parity Overhead vs. 50% Overhead w/Mirror(*)
72% more usable capacity than competitive offerings(*)
(*) Comparing 2P+12D vs. 7+7 Mirror
P
P DP
RAIDProtects against single disk failure
RAID DP Protects against any two-disk failure
© 2008 NetApp. All rights reserved. 17
Cost-Effective Data Reliability
The Problem Double-disk failure is a
mathematical certainty RAID 5 (single parity disk)
– Insufficient protection RAID 10 (mirrored copy)
– Double the cost
NetApp RAID-DP™ Solution Protects against double- disk
failure High performance and
fast rebuild Same protection and
performance as RAID 10 at half the cost
RAID 5 RAID 6 RAID 10 RAID-DP
Cost Low Low High Low
Performance Low Low High High
Resiliency Low High Med High
© 2008 NetApp. All rights reserved. 18
20%Physical Failures
80%Logical Failures
• Physical Failures = CPU, Disk, cables
• System Is Down Until Hardware Replaced
NetApp:
• Using Best of breed HW
• Hot plugable components
• RAID-DP
• Reboot takes 60 seconds
• File system is ALWAYS consistent
• Logical Failures =
Virus attack, bugs, accidental delete
• Requires recovery from tapes
NetApp:
• Invented Snapshot technology
• Smart instant backups
• Up to 255 Snapshots per volumeExample: Every hour for past 48 hours,
Every night for past 14 nights Every weekend for past 3 weekends
• No performance impact
• Backups stay online = fastest recovery
Source: Gartner
Reasons For Downtime
© 2008 NetApp. All rights reserved. 19
Instantaneous Backup, Zero Server Impact
The Problem High server utilization No spare cycles for backups Tape is slow, complex, &
expensive DR can be difficult to manage
NetApp Snapshot™ Solution Servers run apps, not background
processes Instantaneous backup and recovery Low storage overhead Application consistent
Traditional Backup Is NOT Practical
VM1 VM2
CPU Utilization
Fast, Affordable, and Simple Backup and Restores
VM1 VM2
CPU Utilization
Storage Pool
© 2008 NetApp. All rights reserved.
SnapShots – The NetApp way
20
A B
CFile
SnapShot
C
DD Writable
Read Only
Legend
© 2008 NetApp. All rights reserved.
SnapShots – The Competition’s way
21
SnapShot
D
A B
CFile
CC
Writable
Read Only
Legend
© 2008 NetApp. All rights reserved.
C.O.W. Performance Impact
22
Source: Veritest, Nov 2006, NetApp FAS3070 and EMC CLARiiON CX3-80: Comparison Performance and Usability
© 2008 NetApp. All rights reserved.
Useable Snapshots for Rapid Recovery
Market-leading performance
SPC-1 Performance (IOPS)
NetAppFAS3040
EMCCX3-40
Baseline With Snapshots
NetAppFAS3040
EMCCX3-40
24% higher 233% higher30,986 29,958
8,997
24,997
NetApp
– 3% difference
– Snapshots 4/hr
– First RAID-6
EMC
– 64% impact
– Snapshots 1/hr
– Best practice mirroring
© 2008 NetApp. All rights reserved.
SnapMirror - Our Flagship DR Technology
24
SnapMirror
Simple, flexible and cost-effective
Value Proposition
Benefits Simple
–Simple configuration–Integrated with SnapManager–Simplified failover/failback - MultiStore
Flexible–Address a broad range of DR requirements–Operate with FC or IP network–Mirror to/from any NetApp system–Multi-hop, cascading
Cost-effective –Mirror to inexpensive targets–Supports all protocols–Bandwidth efficient with BLI changes–Leverage low cost IP networks–Backup data can be made writeable
LAN
Primary Data Center
DR Site
FAS FAS
NearStore
FAS
© 2008 NetApp. All rights reserved. 2525
VM1 VM2 VM3 VM4
SnapManager for Virtual Infrastructure
Primary Site
VirtualServerAdmin Virtual Center
SMVI
API
VM1VMDK
VM2VMDK
VM3VMDK
VM4VMDK
POLICIES
Storage Pool
StorageAdmin
Policy based management of– Snapshots
– Restores
– Replication
Storage Admin sets and controls policy
Virtual Server Admin delegated to run data management for virtual infrastructure
SMVI coordinated with Virtual Center– VM-aware snapshot
– VM locality
© 2008 NetApp. All rights reserved. 2626
VM1 VM2 VM3 VM4
SnapManager for Virtual Infrastructure Automates Snapshot Replication
VM2VM1
Primary Site DR Site
VirtualServerAdmin Virtual Center
SMVI
API
VM1VMDK
VM2VMDK
VM3VMDK
VM4VMDK
VM5
VM1VMDK
VM2VMDK
VM5VMDK
POLICIES
Storage Pool Storage Pool
© 2008 NetApp. All rights reserved. 2727
VM1 VM2 VM3 VM4
VMware Site Recovery ManagerDisaster Recovery & Runbook Automation
VM2VM1
Primary Site DR Site
VirtualServerAdmin Virtual Center
VM1VMDK
VM2VMDK
VM3VMDK
VM4VMDK
VM5
VM1VMDK
VM2VMDK
VM5VMDK
Storage Pool Storage Pool
SRM SRM
SnapMirror®
SiteFailure
VM1 VM2
Confirm?
© 2008 NetApp. All rights reserved. 2828
VM1 VM2 VM3 VM4
VMware Site Recovery ManagerAutomated DR Testing With FlexClone
Primary Site DR Site
VirtualServerAdmin Virtual Center
VM1VMDK
VM2VMDK
VM3VMDK
VM4VMDK
VM5
VM1VMDK
VM2VMDK
VM5VMDK
Storage Pool Storage Pool
SRM SRM
SnapMirror®
VM1VMDK
VM2VMDK
Test DR
VM1 VM2
© 2008 NetApp. All rights reserved. 2929
VM1 VM2 VM3 VM4
Complementary Site Recovery and Automated Data Protection
VM2VM1
Primary Site DR Site
VirtualServerAdmin Virtual Center
SMVI
API
VM1VMDK
VM2VMDK
VM3VMDK
VM4VMDK
VM5
VM1VMDK
VM2VMDK
VM5VMDK
POLICIES
Storage Pool Storage Pool
SRM SRM
© 2008 NetApp. All rights reserved.
SnapRestore – Immediate Recovery
Active Data Snapshot
ZA B C D
Active data
Recovering any size of volume within secondsRecovering any size of volume within seconds
NetApp is the only one with this incredible feature!!
© 2008 NetApp. All rights reserved.
750 GB database corrupted
Recovery from Database Corruption:
SnapRestore – Immediate Recovery
Tape SnapRestore
Restore Time ~8 Hours A few minutes
Log To Replay Full Day’s (Since last night)
1 Hour
(From last SnapShot)
Log Replay Time HOURS Minutes
© 2008 NetApp. All rights reserved.
Volume Cloning
MailMail
BillingBilling
OracleOracle
Volume clone is immediate – 0 time
Initially takes 0 space
Oracle 2Oracle 2Oracle 1Oracle 1
As blocks get modified, space is consumed
© 2008 NetApp. All rights reserved.
Full copies consume space and time
Production
VM3 VM4
QA
VM1 VM2
Production
FlexClone copies are near-instantaneous and storage efficient
Volume Cloning - FlexClone
Production
VM1 VM2
Mrror
VM4VM3
VM5
Production
© 2008 NetApp. All rights reserved.
Block Level Deduplication of Data
34
Application transparent deduplication Significant capacity savings for:
– Backup data– Archived data– Primary storage
Original Data Duplicatesidentified
Duplicates Removed
(after byte-level comparison)
Looks the same to applications
and users
© 2008 NetApp. All rights reserved. 35
An Opportunity for NetApp Deduplication
VM images consume storage equal to size of template VM images are 100% identical
– OS software, patches, software drivers, application data Save 50% on primary storage requirements after deduplicating
Traditional Enterprise RAID ArraysNetApp FAS System
Duplicate Data Is Eliminated
DATA
APP
OSDATAAPP
OSDATAAPP
OSDATAAPP
OSDATAAPP
OS
DATAAPP
OSDATAAPP
OSDATAAPP
OSDATAAPP
OSDATAAPP
OS
© 2008 NetApp. All rights reserved.
Use 50% Less Storage. Guaranteed*.
Use NetApp for your virtual environments, and we guarantee* you will use 50% less storage
Implement our standard best practices
Use our industry-leading features
– Thin provisioning
– Deduplication
– RAID-DP®
– NetApp Snapshot™ copies
Have us help you install
If you don’t use 50% less storage, get the required
capacity at no additional charge
“We now see an average of 83% reductions in redundant data on our VMware® system.”
- Jonathan Davis, Duke Institute for Genome Sciences and Policy
*For terms and conditions, go to netapp.com/guarantee
50
“During the research phase of your next storage purchasing cycle, ask each vendor if it offers a capacity savings or utilization guarantee.”
Gartner Inc. Nov 2008 April Adams Capacity Savings and Storage Utilization
Guarantees: What's Included, and Are They Worth Considering?
© 2008 NetApp. All rights reserved.
App 2
App 3
App 1
Typical: 40% Utilization NetApp: 70+% Utilization
was
tew
aste
App 2
App 3
App 1
Lower Power, Cooling & Space
Sharedcapacity
8 spindles
12 spindles
6 spindles
6 spindles
Save 50% in Power, Cooling,& Space*
Buy 50% Less Storage*
was
te
Standard Volume Manager NetApp Thin Provisioning
Source: Oliver Wyman Study: “Making Green IT a Reality.” November 2007.
*Thin Provisioning, clones, & multiprotocol all contribute to savings.
© 2008 NetApp. All rights reserved.
Increase Agility with Fast Provisioning
Time-consuming physical copies Slow to provision or reprovision Manual and complex Not suited for VM provisioning
Instant copies with FlexClone®
Quick provisioning with FlexVol®
Simple commands or policies Ideal for dynamic VM environment
NetApp ProvisioningTraditional Provisioning
“The FlexClone feature allows our DBAs to establish new development and test environments in minutes instead of days. Ultimately, this shortens the time it takes to go from a new idea to a new revenue stream by at least 99%.” - Mark Tuttle, Sr. Engineering Mgr, AutoTrader.COM
27 mins
27 mins
3 sec
© 2008 NetApp. All rights reserved.
The NetApp & VMware Global Alliance
Thousands of joint customers
Virtualization Escalation Team for joint support
Reference platform for iSCSI and NFS for ESX3.0
All NetApp products are VMware certified
Deep engineering-level collaboration
Actively engaged across all levels
Mutual Global Partners
© 2008 NetApp. All rights reserved.
So, Can We Do It All?
Backup and restore your VMs instantaneously
Easily protect all your virtualized data with DR
Save 50% on your storage, power, cooling, and space
Deduplicate virtual server and virtual desktop data, enabling 50% space savings, or more
Automate your most labor-intensive data management tasks
Clone and provision storage as quickly as your VMs
Do all of this with one architecture in any environment
© 2008 NetApp. All rights reserved.
With NetApp, We Can!
© 2008 NetApp. All rights reserved.