inter connect2016 yss1841-cloud-storage-options-v4

24
YSS-1841 IBM Cloud Storage Options Tony Pearson IBM Master Inventor and Senior Software Engineer

Upload: tony-pearson

Post on 12-Jan-2017

619 views

Category:

Technology


0 download

TRANSCRIPT

YSS-1841IBM Cloud Storage OptionsTony Pearson

IBM Master Inventor and Senior Software Engineer

Please Note:

1

• IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s solediscretion.

• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

Cloud Storage Taxonomy

Reference Storage• Archives• Images/Video• WORM/NENR

Ephemeral Storage• Typically boot volumes,

page files and temporary data• Goes away when VM

is shutdown

Persistent Storage• Persists across

VM reboots• Can be shared

between VMs• Transactional• High Performance

Storage as the Storage CloudStorage for Compute Cloud

Hosted Storage• File and Object access• File Sync & Share• Backup/Disaster Recovery

2

Cloud Storage Overview

Block

File

Object

Archival

Online

Ephemeral

Persistent

• Block storage offerings are differentiated by speed/throughput (as measured in IOPS) and segmented by lifecycle of the disk. Device location does not matter.

• Ephemeral storage is tied to the lifecycle of a single VM (i.e. it is provisioned when the VM is provisioned and destroyed when the VM is destroyed)

• Persistent storage has a lifecycle independent of any single VM and can be provisioned/destroyed at any time and attached/detached to many VMs during it’s life

• File-based offerings are uncommon among providers, especially among those targeting cloud native applications

• Primarily targeted at cloud enabled workloads

• Usage is being replaced in new application development with online object storage

• Object storage offerings are differentiated by the durability of the data (i.e. odds of irrecoverable loss) and segmented by the availability of the data (i.e. time required to retrieve)

• An object in online storage is immediately accessible

• An object in archival storage may require minutes to hours to be accessible

3

3-15Modules

What’s Different about Spectrum Accelerate?

12 SED1, 2, 3, 4, 6 TB

Optional SSD500, 800 GB

6-12 cores24-96 GB RAM

FCP Ethernet IB

FCP Ethernet IB

6/9-15Modules

Host FCP+ Hyper-Scale

Mobility

Host iSCSI+ Mgmt

Inter-node

6-12 HDD, JBOD1, 2, 3, 4 TB

Optional SSD500-800 GB

4-20 cores32-128 GB RAM

VMware ESXi 5.5

Ethernet

Ethernet

Host iSCSI+ Inter-node+ Management

Pre-built System Software-only

6

VM 2

IBM Spectrum Accelerate for Block-Level Hyperconvergence

� Enables the IT administrator to single-handedly manage the entire data center stack

� Allows hardware standardizationof network, compute, storage, power and environmentals

� Leverages existing Data Center services and maintenance contracts

� Simplifies the architecture when lacking specialized, domain-specific skill sets

Ethernet

Interconnect

Hypervisor

Spectrum Accelerate

Spectrum Accelerate

Spectrum Accelerate

Hypervisor

iSCSI

Hypervisor

VM 1

VM 4

VM 6

iSCS

I

iSCSI

VM 3

VM 5

iSCSI

8

IBM Spectrum Accelerate --- as a Service!

• Single order for Accelerate on IBM SoftLayer

• Operating Expense (OPEX) - no capital required

• Ordered:

– Base of 50TiB

– Increments of 20 TiB

• Two configurations are offered:

– Capacity oriented (for archive type of applications)

– Performance oriented (for real time processing applications)

– Each package includes all features and unlimited traffic

Capacity oriented serversDual CPU 6 cores32 GB RAM11 x 4TB SATA drives10GbE dual private links

Performance oriented serversDual CPU 8 cores64 GB RAM11 x 4TB SATA drives800GB SSD10GbE dual private links

9

Virtualize Your Storage with IBM Spectrum Virtualize

Virtual Server

Infrastructure

Storwize V7000V7000 Unified, V5000

FlashSystem V9000

San Volume Controller

10

Virtual Storage

Infrastructure

Real-time Compression implementation on Spectrum Virtualize

IBM Random Access Compression Engine™Benefits• Hardware-assisted real-time

compression

• Compressed data in cache to increase hit ratios

• More capacity savings than data deduplication for active data

• Compress existing data without downtime

• Compress before Encryption to optimize benefits of both

Upper cache

Lower cache

• Stretch Cluster forwarding• Metro Mirror, HyperSwap

• Compression offloaded to Intel® QuickAssist FPGA

• FlashCopy• Global Mirroring• Thin Provisioning

5x effective capacity!

• Encryption

33

IBM Spectrum Scale – Flexible File and Object Storage

FS1 FS256. . .Exabyte-Scale,

Global Namespace

One big file system or divide into as many as 256 smaller

file/object systems

Each file system can be further divided into filesetcontainers

Metadata can be separated to its own Pool

or intermixed with data

Files and objects can be migrated to tape to reduce costsROBO

Other Datacenters

36

IBM Spectrum Archive™ Overview

IBM Spectrum Archive enables IBM tape libraries to read and write LTFS-format tapes as part of a Spectrum Scale™ global namespace

– Based on the integration of Spectrum Scale™ and LTFS technology

– Supports Spectrum-enabled devices• TS1140 (or higher) Enterprise Drive

• LTO5 (or higher) Ultrium drive

• IBM Libraries TS4500, TS3500, TS3310, etc.

– Integrated functionality with Spectrum Scale• Supports Policy based migrations

• Seamless DMAPI usage

• Data replication to multiple pools

– Supports scale-out for capacity and I/O• Seamless cache controls between Spectrum Archive Nodes

• Tape drive performance balancing

• Multiple node performance balancing

Tokyo Las Vegas London

Clients

Wide Area Network (WAN)

Global Namespace

LTFS LTFS LTFS LTFS

46

IBM Spectrum Scale™ for File Sync-and-Share

SAN

Internal, Direct-Attach

No IT Control:• Servers and storage• Security• Access control • User provisioning• Sensitive data

TCP/IP or RDMA network

Twin-tailed

57

Storage Efficiency with Cleversafe

How to build a highly reliable storage systemfor 1 Petabyte of usable data?

RAID 6 + Replication

1 PB

3.6 PB9003.6x3.6x

3 FTEReplication/backup

Usable Data

Raw Storage4TB DisksRacks RequiredFloor SpaceOps StaffingExtra Software

$$70% +TCO Savings

Cleversafe®

Original

1.20 PB Raw

Onsite mirror

1.20 PB

Raw

Remote

copy

1.20 PB

Raw 1 PB

1.7 PB4321.7x1.7x.5 FTENone

567 TB Raw 567 TB Raw567 TB Raw

Information Dispersal Algorithm (IDA)Erasure coding is used to transform encrypted pieces of data into a customizable number of slices (7 pieces into 12 slices, in this example)

Highly Scalable and ReliableOnly a subset of disks needed to retrieve data (any 7 disks out of 12, in this example)

58

Original Data

Encrypted, Erasure Coded Slices

1211109876543

12

SITE 1 SITE 2 SITE 3

Slicestor®

Appliances

Accesser® Appliance, Application, VM, Docker Container or Embedded

Accesser®

$ 76543

12Original object is encrypted

then cut into pieces

Each slice is written to a separate storage node. In this example, the storage nodes are geographically dispersed across 3 sites.

Information Dispersal Algorithm (IDA)Erasure coding is used to transform the data into a customizable number of slices (7/12 in this example)

Writing Data to Cleversafe

61

SITE 1 SITE 2 SITE 3

Sto

rag

e N

od

es

76

54

3

1

2

1

3 7

2

5

6

4

$

With erasure coding “k” pieces are turned into “n” slices:

Reads can be performed using any k of the n slices• This example is a “7 of 12” Information Dispersal Algorithm (IDA) means only 7

slices are needed to reconstruct the original object

With this IDA, a read can still be executed with any five storage nodes being unavailable out of 12.

With 3 sites, even an entire site outage (plus one additional storage node outage) can be tolerated.

Reading Data from Cleversafe

62

Cloud Storage Positioning

66

Unified file and object storage. Optimized for high performance, across flash, disk and object store

Flash TapeObjectStoreDisk

Object storage on diskFile, backup and archive interfaces available through variety of options

IBM SoftLayerOpenStack Swift

Amazon Web Services S3Swift S3 emulation

Unified file and object storage on tape

Transparent Cloud Storage Tiering (beta)

Information Lifecycle Management across tiers

Hig

h P

erf

orm

ance �

Lower cost �

Object storage pools for IBM Spectrum Protect

On-premises server and object storage pool

Object storage

On-premises server, off-premises object storage

pool

Server

Object storageObject storage

On-premises server replicating to server in cloud

ServerObject storage

Replication

Server

TCP/IPClients

Off-premises server and object storage pool

Clients

Clients

Server

Clients

Server

� “Cloud” storage pools will exploit object-storage APIs provided by cloud, without need for gateway� Native cloud storage support based on container pools (not enabled for use as copy pool or database

backup media)� Initial support

– OpenStack Swift, including IBM SoftLayer, IBM Cleversafe and IBM Spectrum Scale– Client backup/restore, archive/retrieve directly to/from object-storage pool

Storage hierarchy

Clients

80

Cloud Storage Taxonomy

Storage as the Storage CloudStorage for the Compute Cloud

Persistent Storage

• Persists across VM reboots

• Can be shared between VMs

• Transactional• High

Performance

Reference Storage

• Archives• Images

Video• NENR and

WORM

Ephemeral Storage• Typically boot

volumes, page files and temporary

• Goes away when VM is shutdown

Hosted Storage• File Storage• Object Storage• Backup• Disaster

Recovery

IBM XIV / SVC / DS8000 / FlashSystem Cleversafe, Spectrum Archive

Spectrum Scale, Elastic Storage ServerTransactional Performance

Universal Access

LowestTCO

81

Notices and Disclaimers

82

Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law

Notices and Disclaimers Con’t.

83

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.

IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

Thank YouYour Feedback is Important!

Access the InterConnect 2016 Conference Attendee Portal to complete your session surveys from your

smartphone,

laptop or conference kiosk.

IBM Tucson Executive Briefing Center

• Tucson, Arizona is home for storage hardware and software design and development

• IBM Tucson Executive Briefing Center offers:

– Technology briefings

– Product demonstrations

– Solution workshops

• Take a video tour!

– http://youtu.be/CXrpoCZAazg

85

86

About the Speaker

Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM Corporation in

1986 in Tucson, Arizona, USA. In his current role, Tony presents briefings on storage topics covering the entire IBM Storage product

line, Software Defined Storage, Analytics, Watson, and Cloud Computing. He interacts with clients, speaks at conferences and events,

and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware,

and virtualization products.

Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners every

week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1 most read IBM

blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V.

Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and

software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical

Engineering, both from the University of Arizona. Tony has 19 patents for inventions on storage hardware and software products.

9000 S. Rita Road

Bldg 9032 Floor 1

Tucson, AZ 85744

+1 520-799-4309 (Office)

[email protected]

Tony Pearson

Master Inventor

Senior Software Engineer

IBM Storage

Email:[email protected]

Twitter:twitter.com/az99Øtony

Blog: ibm.co/Pearson

Books:www.lulu.com/spotlight/99Ø_tony

IBM Expert Network on Slideshare:www.slideshare.net/az99Øtony

Facebook:www.facebook.com/tony.pearson.16121

Linkedin:www.linkedin.com/profile/view?id=103718598

Additional Resources from Tony Pearson

87