© 2007 hitachi data systems storage trends and directions services oriented storage solutions...
Post on 21-Dec-2015
214 views
TRANSCRIPT
© 2007 Hitachi Data Systems
Storage Trends and DirectionsServices Oriented Storage Solutions
Hitachi Data Systems
Hubert Yoshida
VP and CTO
October, 2007
2© 2007 Hitachi Data Systems
The Dynamics of Storage Growth
• Storage growth rate is compounding
• Regulations and disaster recovery drive longer retention, with redundant copies
• Transaction access rates growing faster than capacity for operational data
• Utilization of storage continues to be less than 30%
• Technology changes faster than capitalization rate
• Whatever you install today will be replaced in 3 to 5 years
Technology refresh becomes more disruptive as capacity grows
0
1000
2000
3000
4000
5000
6000
7000
8000
9000
Source: IDC and A.G. Edwards Projection 4/11/05
Peta Bytes Shipped
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009
3© 2007 Hitachi Data Systems
Total Digital Archive Capacity, by Content Type – Worldwide (TB)
30,000,000
20052006
2007 20082009
2010
25,000,000
20,000,000
15,000,000
10,000,000
5,000,000
0
The Changing Forms of Data
Database
Unstructured
4© 2007 Hitachi Data Systems
Meanwhile, The Business EnvironmentIs Changing
• Opportunities – Mergers, acquisitions, consolidation – Global expansion – “The world is flat” – New services and technology enablers– Cross selling and up selling
• Exposures– Operational risk
• Threat of wide-scale disasters, Global Warming, over runs, terrorism
– Regulations and Corporate Governance• Tighter controls, audits, transparency
– Economic uncertainty• Rising interest rates, Rising energy Costs
• IT Constantly Must Align and Adapt to Changing Business Challenges
7© 2007 Hitachi Data Systems
Who Took My Storage?
DataData
ALLOCATED/UnusedALLOCATED/Unused
Copies 3 to N
RAID OverheadStranded STORAGEStranded STORAGE
Lead Time BufferLead Time Buffer
8© 2007 Hitachi Data SystemsDataData
ALLOCATED/UnusedALLOCATED/Unused
Stranded STORAGEStranded STORAGE
Lead Time BufferLead Time Buffer
Copies 3 to N
HW Costs Are Only Part of the TCO Iceberg…
HardwareCosts
EnvironmentalEnvironmentalEnvironmentalEnvironmental
Change ManagementChange ManagementChange ManagementChange Management
Scheduled Down TimeScheduled Down TimeScheduled Down TimeScheduled Down Time
Backup and RecoveryBackup and RecoveryBackup and RecoveryBackup and Recovery
Device MigrationDevice MigrationDevice MigrationDevice Migration
ManagementCost
The ratio of Management to hardware costs are2:1 to 4:1 or more
As a result the Cost of IT is not tracking to Revenue
9© 2007 Hitachi Data Systems
The Traditional Storage Models No Longer Work
• Expensive High Function Monolithic Storage
• Lower Cost, low function, Modular Storage
• 20-year-old architectures that were designed for:– Direct attached storage – No sharing– Two Shift Operations – Maintenance widows– GBs of Capacity – Easy to manage and migrate
12© 2007 Hitachi Data Systems
Creating Islands of Storage Will Not Help
VTL
RISS
CAS
AXIOMNAS
Nearline
InServ S800
13© 2007 Hitachi Data Systems
Next Big Thing: Intelligent Storage Virtualization
Commodity Media Commodity MediaINTELLIGENT
Control Unit
Low Cost SATA DiskOther High End Arrays
Hitachi has changed the playing field by separating the commodity media (disks) from the innovation ( intelligent control unit), breaking the monolithic growth spiral
and enhancing modular and niche storage with common high end services
Combining the Best of Both Worlds
Universal Storage Platform
USP
14© 2007 Hitachi Data Systems
External Storage Virtualization Through The USP Control Unit
Array Array GroupGroup
Mapped Mapped
HBA HBA Port Port
Target Target Port Port
ELUN
HOSTHOST
Host ViewDevices
InternalDevices
USP Internal Storage External Storage
USP Storage Controller
External External Port Port
Target Target Port Port
VDEV VDEV VDEVVDEV
LUNLUN
LDEV LDEV
HDDHDD
LUNLUN LUNLUN LUNLUN LUNLUN LUNLUN LUNLUN
LDEV LDEV LDEV LDEV
LDEV LDEV
LDEV LDEV LDEV LDEV
LDEV LDEV
LUNLUN LUNLUN
ELUN — LUN that is mapped to a LUN in anexternal storage device
15© 2007 Hitachi Data Systems
Hitachi Storage Control Unit Based Virtualization:The Key Enabler for Services Oriented Storage
• Hitachi storage controller based virtualization:
– Provides common storage and data services for all heterogeneous storage and application requirements
– Adds no complexity or latency
– Is not limited to SAN connection
– Preserves end-to-end security
– Enables seamless integration of future capabilities
WAN
NAS MainframeVTL
CASApps
16© 2007 Hitachi Data Systems
Hitachi Thin Provisioning Software
• Optimize Storage Capacity by provisioning only what is used
• Optimize Storage performance by spreading the I/O across more arms
• Simplify Management by allocating what is asked for and automatically provisioning only what is used
• Simplify performance tuning by spreading the I/O across all the disks in the Pool
LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV
HDP Pool
HDP Volume(Virtual LUN)
Array Groups/Disk Drives
LDEVs
Servers
17© 2007 Hitachi Data Systems
DataData
ALLOCATED/UnusedALLOCATED/Unused
Stranded STORAGEStranded STORAGE
Lead Time BufferLead Time Buffer
Copies 3 to N
DataData
ALLOCATED/UnusedALLOCATED/Unused
Copies 3 to N
Stranded STORAGEStranded STORAGE
Lead Time BufferLead Time Buffer
Taking Back Your Storage
Reduce cost with lower tiers
Dynamic Provisioning
Dynamic Provisioning and lower cost tiers
Virtualization and logical partitioning
Virtualization and Dynamic migration
RAID Overhead
Reduce RAID overhead with RAID 5
Dynamically migrate between RAID types
RAID Overhead
18© 2007 Hitachi Data Systems
Operational Benefits of Hitachi Virtualization and Dynamic Provisioning
EnvironmentalEnvironmentalEnvironmentalEnvironmental
Change ManagementChange ManagementChange ManagementChange Management
Scheduled Down TimeScheduled Down TimeScheduled Down TimeScheduled Down Time
Backup and RecoveryBackup and RecoveryBackup and RecoveryBackup and Recovery
Device MigrationDevice MigrationDevice MigrationDevice Migration
Common Heterogeneous management, non disruptive configuration changes, HSSM, HTnM, HTSM
Non disruptive heterogeneous storage migration
VTL and de-duplication reduces B/R times, multi-tier storage reduces costs, Backup Services ManagerHeterogeneous replication
Non disruptive maintenance, migration, upgrades, provisioning
Reduced storage and SAN footprint, power, cooling through consolidation
EnvironmentalEnvironmentalEnvironmentalEnvironmental
Change ManagementChange ManagementChange ManagementChange Management
Scheduled Down TimeScheduled Down TimeScheduled Down TimeScheduled Down Time
Backup and RecoveryBackup and RecoveryBackup and RecoveryBackup and Recovery
Device MigrationDevice MigrationDevice MigrationDevice Migration
19© 2007 Hitachi Data Systems
VTL
RISSCAS
AXIOM
NAS
Nearline
InServ S800
Content
Services
Content
Services
TieredStorageServices
File Services
Thin Provisioning
Services
Virtual Tape
Services
Thin Provisioning
Services
Hitachi Can Consolidate Different Storage Requirements with a Common Services Platform
Content
Services
TieredStorageServices
File Services
Virtual Tape
ServicesThin
ProvisioningServices
20© 2007 Hitachi Data Systems
Enterprise Class Replication Services
P-Vol(ELUN)
S-Vol(ELUN)
P-Vol(ELUN)
S-VolLUN
P-VoLUN
S-Vol(ELUN)
LUN
LUN
LUN
LUN
Universal Storage Platform
Mapped
Mapped Mapped
Mapped
• TrueCopy and Universal Replicator provide one common replication service for heterogeneous storage – no need to buy different replication for different vendors• Use TrueCopy for synchronous and Universal Replicator for asynchronous replication
Universal Storage Platform
Primary Site Secondary Site
EMC, IBM. HDS,SUN, HP
EMC, IBM, HDS,SUN, HP,
21© 2007 Hitachi Data Systems
Primary Site
Secondary Site
Less bandwidth required to replicate data over distance
Master Server
Deduplication Services with Remote Replication
22© 2007 Hitachi Data Systems
Power and cooling exceeds server Spending – IDC 2006
$0
$10
$20
$30
$40
$50
$60
$70
$80
1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009
Installed base(M units)
2
4
6
8
10
12
14
16
18
Spending(US$B)
New server spendingPower and cooling
Power and CoolingInexpensive dense computing and increasing power costs are shifting requirements and spending
What is the greatest facility problem with your primary data center?
Gartner, Best Practices in Data Center Facilities, Michael Bell, October 2006
Excessive Heat
Insufficient Raised Floor
Insufficient Power
Poor Location
Excess Facility Cost
None of the above
29%
21%
29%
6%3%
13%
N = 112
Cost of power = cost of purchase for servers (2007), = 40% cost of purchase for storage Power and cooling will be a top 3 issue with all CIOs in the next 6-12 months”
Michael Bell – Gartner
Increasing Expense of Power and Cooling
23© 2007 Hitachi Data Systems
Storage Products are not the worst offenders – However…..
Storage Products Are not the
Worst Offenders
24© 2007 Hitachi Data Systems
Components of Data CenterPower Consumption
Storage Power Consumption/GB
Data Center Storage UsageExternal PB Shipped
Data Center Storage Power Growth
Cooling
Server&Storage
Conversion
Network
Light
0
5000
10000
15000
20000
2005 2006 2007 2008 2009 20100
0.20.40.60.8
11.21.41.6
2005 2006 2007 2008 2009 2010
0
0.2
0.4
0.6
0.8
1
2005 2006 2007 2008 2009 2010
Expected Storage Power Growth
25© 2007 Hitachi Data Systems
New data centres to be designed as energy efficient and contribute to corporate carbon neutral targets
CUSTOMER ECO REQUIREMENTS
To become the first major bank to become carbon neutral by 2009
Committed to reducing carbon emissions by 40% by 2011. By 2008 it will seek 25% energy efficiency by upgrading infrastructure
Plans to become carbon neutral by 2013 with revised targets implemented after this deadline
BT will reduce its CO2 emissions 80% below 1996 levels. Currently deploying “Data Centre of Future” across estate
CIO officers allocated with energy efficiency targets. Global head of storage to find 30% power savings by 2009
Committed to reduce GHG emissions by 10% by 2010 with ambitions programme to achieve environmental certification for the construction of all new operations centres
26© 2007 Hitachi Data Systems
“New Energy Efficient Storage Architectures
Regulations• Energy Star, RoHS, WEEE• EPA study report based on H.R. 5646
Standards and Incentives• The Green Grid• PG&E’s “High Tech Energy Efficiency Incentives”
Server Pool
Power & Cooling management(monitoring, control)
Optimization amongmultiple datacenters
Power consumption reductionfor archive/backup dataHDD spin downDe-duplication
Server Virtualization & Storage Virtualization
Environmental Audit
Thermal density trend and forecastin datacenter
Flash
High efficient cooling system (e.g. Liquid cooling)
Archive data
Storage Pool
2.5”HDD
Power saving mediums and new DKC architecture adapting to them
Power saving functions・ Virtualization• Thin Provisioning・ Power monitoring・ CPU clock down・ Application control linkage
Flash memory
27© 2007 Hitachi Data Systems
Steady Decline in $ per GB
05
101520253035404550
Q102
Q202
Q302
Q402
Q103
Q203
Q303
Q403
Q104
Q204
Q304
Q404
Q105
Q205
US$
External+Internal StorageQuarterly 2002-2004, Q1-Q2 2005
Source: IDC Asia/Pacific 2005
28© 2007 Hitachi Data Systems
Technology Transition Roadmap
Time
Are
al
Den
sity
Longitudinal Recording
100-130
500-800
1,000-3,000
2,000-15,000
Perpendicular Recording
Patterned Media (PM)
Thermally Assisted Recording (TAR)
2006 2010 2014
• 50 Years• >50 Million increase in areal density
10,000 Gb/in2 = 10 Tb/in2
50 TB 3.5-inch drive12 TB 2.5-inch drive
1 TB 1-inch drive
New Technologies will increase DensitiesWill Prices decline at the same rate?
29© 2007 Hitachi Data Systems
Virtual Controllers: Where the Storage Industry is Heading
• IN THE FUTURE, CUSTOMERS WILL SELECT A ‘VIRTUAL CONTROLLER’ AND MATCH IT TO ANY TYPE OF DISK MEDIA
STORAGE-AGNOSTIC REPLICATION
LOGICAL PARTITIONING
EMBEDDED VIRTUALIZATION LAYER
POINT-IN-TIME REPLICATION
EMBEDDED VIRTUALIZATION LAYER
High-Feature
Mid-Feature
Basic
EMBEDDED VIRTUALIZATION LAYER
BASIC READ / WRITE COMMANDS
FC
INTELLIGENT VIRTUAL CONTROLLER DISK MEDIA
SATA
ATA
30© 2007 Hitachi Data Systems
Transforming IT From Stove Pipe Infrastructures to Dynamic Data Centers
Storage Networks
Server Networks
Application A
Application B
Application C
SOAServicesOriented Architecture
SOIServicesOriented Infrastructure
SOSServicesOriented Storage Solutions
31© 2007 Hitachi Data Systems
Hitachi Virtual Tiered Storage Infrastructure
• Services Oriented Infrastructure based on server virtualization and reusable processor services
Server & Storage Migration
Virtualized Server Cluster
Migration
Migration
• Services Oriented Storage based on Storage controller virtualization and reusable storage services
Server and Storage Virtualization ProvideApplication & Data Mobility
32© 2007 Hitachi Data Systems
Summary
• Storage growth continues to accelerate while utilization remains a challenge.
• Storage arrays built on 20 year old architectures can not meet today’s dynamic requirements
• New Storage Requirements Need to be addressed as services – not with box solutions
• Services Oriented Storage simplifies storage infrastructure, reduces risk, and reduces cost with common services that can be leveraged across all storage assets
• Efficient utilization of storage is Green Storage
• The Dynamic Data Center of the future will be based on services orientation, SOA, SOI, SOS
34© 2007 Hitachi Data Systems
Technology
• Servers and Operating Systems – 2011 and beyond
– Predictions are that by 2013 a Supercomputer will be built that exceeds the computational capabilities of the human brain
– By 2023, it will take a $1000 computer to exceed the capabilities of the human brain
– …and while prediction beyond this are difficult to estimate, 15 years later in 2049 a $1000 computer will exceed the computational capabilities of the entire human race
– Digital Information will exceed the available capacity of storage