infoboom future-storage-aug2011-v3

39
© 2011 IBM Corporation The Future of Storage Tony Pearson – IBM Master Inventor and Senior Managing Consultant August 2011

Upload: tony-pearson

Post on 08-Sep-2014

3.295 views

Category:

Technology


0 download

DESCRIPTION

Infoboom webcast, August 23, 2011. This session covers the futures of IT storage, including the shifting roles of SSD, disk and tape; convergence of LAN and SAN networks into a data center network; and the emergence of storage for Cloud Computing.

TRANSCRIPT

Page 1: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

The Future of Storage

Tony Pearson – IBM Master Inventor and Senior Managing Consultant

August 2011

Page 2: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

2

The Future of Storage, with Tony Pearson

The storage landscape is changing as a result of the convergence of virtualization, improvements in energy efficiency, cloud computing and users' insatiable demand for data. With adoption of server virtualization, storage is taking over as fastest-growing part of a typical company's information infrastructure.New technologies are changing the way organizations manage their storage assets. Flash storage delivers more flexibility in creating hierarchical tiers to meet different demand priorities. Storage virtualization enables businesses to increasingly treat all their storage assets as a single pool. Data deduplication can significantly reduce redundancy. Cloud storage is another intriguing option, providing the capability to dynamically move storage assets to a shared model.These and other advances require IT organizations to rethink the way they classify their storage assets. In this presentation, Tony Pearson outlines the seismic forces that are reshaping the storage landscape. You'll learn:

– How the shift in roles assigned to each storage type can be used to optimize storage and retrieval efficiency;

– How to take advantage of multiple tiers of storage via automated and policy-driven methods; – How to apply the convergence of data center networking technologies - including FCoE, iSCSI, NFS

and CIFS protocols, as well as voice and video - to your environment; – The importance of cloud computing, and the ways storage can participate in this new scheme.

Presented Live – Infoboom Webcast -- August 23, 1pm EDT

Page 3: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

3

Agenda

Energy costs, economics and performance are driving a shift in the roles of each storage type

Improvements in bandwidth are driving a convergence of networks

Cloud computing is driving standardization, automation and management that also impact internal IT departments

Page 4: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

4

Typical Data centers have 2.5 Power Usage Effectiveness (PUE) rating

IT Load

60% 40%

Power and Cooling

How energy is typically used in the data center

63%37%

StorageServers,

Networking . . .

With adoption of server virtualization, storage is taking over as fastest growing part of

Information Infrastructure

Source: Dell, IDC, UC Berkeley, Green Data Project Preview: http://www.drunkendata.com/?p=1233

Page 5: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

5

Storage Hierarchy

DRAM CacheSolid-State Drives (SSD)Phase Change Memory

10K/15K RPM disksFibre Channel SAN

Tape

7200 RPM disksVirtual TapeNAS/iSCSI

Faster Disks (15K/10K RPM) ~ up to 435 W/TB

Solid-State Drives ~120 W/TB

Slower disks (7200 RPM) ~ 40 to 115 W/TB

Tape ~ 2 W/TB

Page 6: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

6

Solid-State Drives will be the only storage

you need

Are you sure about that ?

Page 7: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

7

IOPS per Watt – A new Metric for SSD

� Solid-State Drives (SSD) are most appealing for random read-intensive I/O workloads

� Previous attempts to increase IOPS:

– Heavily use DRAM cache

– Short-stroke the spinning disk

– Stripe data across many spindles

20,000

70

Page 8: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

8

0

20

40

60

80

100

120

140

Typical R/W Operation

0

5

10

15

20

Typical R/W Operation

15K FC/SAS 300GB 7200 SATA 500GBSSD 73GB SSD 16GB

Wat

ts /

Driv

eW

atts

/ T

B

Drive Power Use

Source: IBM, STEC

Solid State Drives (SSD)

Solid State Drives (SSD) offer some interesting characteristics:

– More Reliable: 1% AFR vs. 3-8% for HDD– Lower energy consumption (Watts / Drive)– Faster read / Slower write destage

Best place to initially put this technology: drive-for-drive replacement inside servers

– Reduce outages, Improve Resiliency– Save 1500 Watts per server rack– Fast operating system reboot

Watts per TB tells a different story…– Spinning Disk can provide lower Watts/TB

Page 9: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

9

Hard Disk Drives and NAND Flash Storage Comparison

Source: IBM Almaden Research, Steven R. Hetzler, Sep 2009

Page 10: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

10

One wafer =30,000 GMR

heads

One wafer =425 dies

Daily Output:1,250 wafers

Result:14,000 PB/line/year@375 GB per HDD

Daily Output:100,000 disks

Result:390 PB/line/year@2 GB per die

$11 to $17B USD investment

required for SSD to capture 1% of

HDD marketWafer

Source: IBM Almaden Research, Steven R. Hetzler, Sep 2009

SDD and HDD Production Lines

35x

Page 11: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

11

Storage Hierarchy

Performance-Driven Automated Tiering

Easy TierSSD + Disk

Virtual Tape Libraries

Policy-Driven Information Lifecycle

Management (ILM)

Older, infrequently accessed

information

Long-Term Retention

Archive

Page 12: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

12

IBM System Storage Easy Tier saves energy

9.5 kW 5.7 kW

Easy Tier achieved better performance in 50 percent less floor space and 40 percent less energy. Save up to $100,000 in pow er and cooling for

roughly 75 TB of usable data over three years.

Page 13: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

13

Enhancing Storage Efficiency

� Data deduplication is a method of reducing storage needs by eliminating duplicate copies of data.

– Store only one unique instance of the data

– Redundant data replaced with pointer to the unique instance

C

A

B

C

AA B

B

A C

A

B

C

AB

B

A

A

� Real-Time Compression is a method of reducing storage needs by changing the encoding scheme as the data is being read and written.

– Short patterns for frequent data

– Longer patterns for infrequent data.

– Can achieve 20 to 80 percent reduction in storage capacity.

Page 14: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

14

Tape’s substantial cost advantage over disk continu es through 2015

0

2

4

6

8

10

12

14

16

10 yr Archive(Clipper Gp)

5 yr Backup(ESG Study)

TCO Comparison

Disk Tape

$/GB for Storage Media

1.E-03

1.E-02

1.E-01

1.E+00

1.E+01

1.E+02

1.E+03

1.E+04

1.E+05

1990 1995 2000 2005 2010 2015

Year

$/G

Byte

DRAM

NAND

HDD 2002 estimated CAGR

Tape

Credit Suisse 2008 Study

Grochowski 2003

IDC 08

HDD History

Tape

Tape’s cost advantage over disk also contributes to a signification TCO advantage

Page 15: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

15

Tape

$946,405

$7

$3.5

$0

Mill

ions

SATA Disk

$6,365,950

Blended Disk and Tape

$2,255,346

Hardware

Prod + DR Carts

Maintenance

Power & Cooling

Floor space

Consider the long-term costs of ownership

� SATA disk lower cost access to online data than FC disk

� Tape less than disk and consumes less energy, but often not ideal for online access

� Blended solution:

– Online access to most recent content

– Lower cost, energy-efficiency for long-term

Cut TCO 50% with Blended Tape and Disk*10 year TCO example. Assumes 250TB storage, 25% growth/yr

* TCO estimates based on IBM internal studies.

IBM Brings Together Disk and TapeBlended solutions provide performance and lower energy costs

Page 16: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

16

Linear Tape File System (LTFS)

� LTFS Single Drive Edition– Mount the tape

– Display directory of tape contents

– Read and Write files

– Drag and drop as needed to local disk

� LTFS Library Edition

– Display Library as collection of directories

– Selecting directory mounts the tape

– Read and Write files

– Drag and drop as needed to local disk

Tapes in Library

appear as directories

Tape contents

Page 17: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

17

The Shifting Roles of Storage

Solid-State Drives (SSD)

Combined with slower 7200 RPM disk to reduce energy costs over 15K RPM drives

“Flash & Stash”

Disk replication and Virtual Tape Libraries

Improved by high-capacity 7200 RPM disks, compression, deduplication

Physical tape, combined with automation

Linear Tape File System (LTFS)

Primary Data

Backup Data

Project Task Folder

Long-term Space Management and

Data Retention

Page 18: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

18

Agenda

Energy costs, economics and performance are driving a shift in the roles of each storage type

Improvements in bandwidth are driving a convergence of networks

Cloud computing is driving standardization, automation and management that also impact internal IT departments

Page 19: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

19

The New Era of Smarter Computing

DistributedComputing

CentralizedComputing

SmarterComputing

1952 1981 Today

Thousands of IT Professionals

Millions of Office Workers

Billions of People

Page 20: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

20

Data Center Fabric Convergence – “One Wire”

Fabric Convergence

Servers Multiple Fabrics Converged Fabric

Page 21: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

21

Convergence of Networks

Local Area Network Data Center

Network

Host Bus Adapter (HBA)

Network Interface Card (NIC)

10/100/10001GbE

10GbE

2 Gbps4 Gbps

8 Gbps16 Gbps

Storage Area Network Converged Network

Adapter (CNA)

10GbE40GbE100GbE

Converged Enhanced Ethernet (CEE)

• Data, Voice, Video

NFS, CIFS, iSCSI, FCoE, HTTP

Page 22: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

22

Agenda

Energy costs, economics and performance are driving a shift in the roles of each storage type

Improvements in bandwidth are driving a convergence of networks

Cloud computing is driving standardization, automation and management that also impact internal IT departments

Page 23: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

23

“People do not want quarter-inch drills. They want quarter-inch holes.”

Professor Emeritus Theodore Levitt, Harvard Business School

Page 24: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

24

The Evolution of IT Resource Virtualization

Virtualization is technology that makes one set of resources look and feel like another set of resources, preferably with more

desirable characteristics

Server sprawl

One Workload, One Server

One Workload, Many Servers

Many Workloads, One Server

PhysicalConsolidation

LogicalConsolidation

GB

GHz

Gbps

Workload• Sequential• Random

Compute• Lightweight• IO-Intensive• CPU-Intensive

Bandwidth• Messaging• Storage / IO• Voice / Video

Page 25: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

25

Application Service Provider

Time-Sharing

Grid Computing

Cloud Computing

Origins of Cloud Computing

If computers of the kind I have advocated become the computers of the future, then computing may

someday be organized as a public utility just as the telephone system is a public utility... The computer utility could become the basis of a new and important industry.

—John McCarthy, MIT Centennial in 1961

In the 1960s and 70s, several companies provided time-sharing

services as service bureaus

Page 26: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

26

2010

Application Service Provider

Cloud Computing

“Clouds will transform the information technology (IT) industry…profoundly change the way people work and companies operate.”

Cloud – A Disruptive New Paradigm?

Cloud computing is a pay-per-use model for enabling network access to a pool of computing resources that can be provisioned and released rapidly with minimal management effort or service provider interaction.

� Network access

� Rapid Elasticity

� Pay-per-use

� Self-service

� Pool of Resources

Grid Computing

Time-Sharing

Source: US National Institute of Standards and Technology (NIST.gov)

Page 27: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

27

Preliminary TCO Analysis

� Compares traditional model vs. Cloud Computing serv ice

� Includes acquisition, management, power/cooling, fl oor space

� Also includes network circuit cost, with full redun dancy

� Circuit costs are offset by economies of scale, red uced operational costs

� Initial modeling shows 43% savings over 4 years, an d 73% in year 1

Traditional Data Center Cloud Computing Services

Source: IBM

Page 28: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

28

Cloud Deployment and Delivery Models

Public cloud

Hybrid cloudPrivate cloud

Traditional enterprise IT

Business Process

Software-as-a-Service(SaaS)

Middleware and Development ToolsPlatform-as-a-Service

(PaaS)

Servers, Storage and Networking HardwareInfrastructure-as-a-Service

(IaaS)

� Bandwidth� Packaged Apps� Compliance� Proprietary

� Desktop� Develop / Test� Analytics / Mining� Help Desk

� Backup/Archive� eMail / Office Apps� Web Hosting� Conferencing

Enterprise

DeploymentModels

DeliveryModels

Page 29: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

29

Visibility across Applications,

Data and Underlying

InfrastructureService Management

Control Aligned toBusiness Priorities

Process and Technology

Automation acrossBusiness Services

How are infrastructure events affecting services?

MonitorInfrastructureResources

Map Service Dependencies

to InfrastructureHow are resources connected to

provide business services?

Automate Service

Operations

Are activities efficiently executed when delivering business services?

IBM Integrated Service Management

Traditional enterprise IT

Public cloud

Page 30: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

30

� There is a significant shift in storage usage from traditional structured data to unstructured, file storage content.

� ‘Content Depots’ are emerging in storage market in areas like archiving, media repositories, web content, health records, etc. Some reports show this space growing at +90% annually.

30

W o r l d w i d e F i l e - B a s e d vs B l o c k - B a s e d S t o r a g e

C a p a c i t y S h i p m e n t s , 2 0 0 9 – 2 0 1 4

Source: IDC's 2010 Enterprise Disk Storage Consumption Model

Note: file storage requires significant superset of Fibre Channel SAN skills:

Application, network, user file system

File-Based Storage Market Opportunity

Page 31: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

31

What is Cloud Storage?

Hosted Storage• Production• Backups• Archives

Ephemeral Storage• Typically boot volumes• Goes away when VM

is shutdown

Persistent Storage• Persists across VM reboots• Can be shared between VMs

Three types of Cloud Storage

Page 32: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

32

IBM Smart Business Development and Test Cloud

Scale-Out Network Attached Storage (SONAS)• Up to 11 PB of usable storage• Read/Write access via CIFS, NFS, HTTP, FTP, SCP• Policy-driven placement, movement and expiration

iDataPlex• Up to 10 iDataPlex systems per SONAS disk system• Each iDataPlex has 168 servers sharing 1 file system

Hypervisor

Virtual Machines• Up to 32 VMs per iDataPlex server• Used for ephemeral and persistent storage needs• Each file in standard 256GB, 512GB, or 2TB size• Appears as “Block Storage” to the virtual machine

32 x 168 x 10 = 53,760 VMs per SONAS

Page 33: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

33

Cloud Prediction from Sun CTO Greg Papadopoulos

� A "neutron star collapse of data centers"

–It won't make sense for businesses to build their own data centers.

� Hosting providers will bring "brutal efficiency" for utilization, power, security, service levels, and idea-to-deploy time.

–A half dozen very large cloud infrastructure providers and a hundred or so regional providers

� Look more like the banking world

–Customers will trust service providers with their private data as they do banks with their money.

Page 34: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

34

Agenda

Energy costs, economics and performance are driving a shift in the roles of each storage type

Improvements in bandwidth are driving a convergence of networks

Cloud computing is driving standardization, automation and management that also impact internal IT departments

Page 35: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

35

Page 36: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

36

IBM Tucson Executive Briefing Center

Contact Us

For more information, visit: http://ibm-vbc.centers.ihost.com/briefingcenter/tucson

To book a briefing, please contact your IBM Representative, IBM Business Partner, or Briefing Center Coordinator, Lee Olguin at +1 (520) 799-5460.

Page 37: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

37

About the Speaker

Mr. Tony Pearson

Master Inventor,

Senior Managing Consultant

IBM System Storage™

Tony Pearson is a Senior IT storage consultant for the IBM System Storage™ product line.

Tony Pearson joined IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. Over the past years, Tony has worked in

development, marketing and customer care positions for various storage hardware and software products.

In his current role, Tony presents briefings on storage topics covering the entire System Storage product line, as well as various Tivoli storage

software products. He interacts with clients, speaks at conferences and events, and leads workshops to help clients with strategic planning for IBM’s

integrated set of storage management software, hardware, and virtualization products.

Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners every week. This blog

was rated one of the top 10 blogs of 2006 for the IT storage industry by “Networking World” magazine. The blog was published in book form as

“Inside System Storage: Volume I” available from Lulu publishing.

Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and software products.

9000 S. Rita RoadBldg 9070 Mail 9070Tucson, AZ 85744

+1 520-799-4309 (Office)

[email protected]

Tony Pearson

Master Inventor,Senior Managing Consultant

IBM System Storage™

Page 38: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

38

More about Tony Pearson

Social Networks: • tinyurl.com/az990tony (blog)• twitter.com/az990tony• slideshare.net/az990tony• linkedin.com/profile/view?id=103718598• flickr.com/photos/26449036@N06/

Tony’s book series “Inside System Storage” Volume I and Volume II are available in various formats: www.lulu.com

Page 39: Infoboom future-storage-aug2011-v3

© 2011 IBM Corporation

Infoboom - The Future of Storage with Tony Pearson

39

Trademarks and disclaimers© IBM Corporation 2011. All rights reserved.References in this document to IBM products or services do not imply that IBM intends to make them available in every country.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provided "AS IS" without warranty of any kind.

The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance numbers are taken from publicly available information, including vendor announcements and vendorworldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the supplier of those products.

All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here.

Prices are suggested U.S. list prices and are subject to change without notice. Starting price may not include a hard drive, operating system or other features. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Changes may be incorporated in production models.

Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml.

ZSP03490-USEN-00