VMware Hybrid Cloud –

An Introduction to Object Store

Rachna Thusoo, Vmware

Rick Brauen, VMware

PHC5734

#PHC5734

2

Agenda

Introduction

Current State of Storage

Structured and Unstructured Data

Applying Traditional Storage Paradigms To Unstructured Data

Object Storage

Use Cases

Getting Started With An Object Store

Summary

3

Introduction

4

IT Organization Buried Under Conflicting Demands?!

I need more

storage NOW!

End User

IT just can’t

move fast

enough…!!

I need 20 TB

storage to perform

testing for

two months

CIO

We need to cut storage

budget for the

next year.

Provide me

storage forecast

for the next

three years!

Storage

procurement

requires a lead time

of six weeks

5

Got Storage?!

6

Storage – Current State of Affairs

7

Crux Of The Problem? Digital Data Is Growing Exponentially.

From now until 2020, the digital data will DOUBLE every two years!!

8

Top IT Storage Concern? Insufficient Resources and Budget

9

Storage Consumption Rapidly Tipping Towards Being Unstructured Data Centric

10

Structured and Unstructured Data

11

Structured Data

Organized in a predefined manner

Data easily identifiable because of the structure

Meaningless if interpreted independently

12

Unstructured Data

Use generated data that is not organized in a pre-defined manner

Data meaningful in itself

Typically static – almost 70% data not touched again after creation

Difficult to understand the context and content of the data in

absence of metadata

13

Applying Traditional Storage Paradigms Insufficient

14

Traditional File Systems – Suboptimal for Unstructured Data

Designed for concurrent access

Limitations on Scale

Built to enable simultaneous read and write operations

Built to deal with overhead to manage permissions and operations

Data stored in hierarchical system - Metadata is basic

Performance Degrades as the number of nested folders increases

15

Traditional Storage Approach – Suboptimal For Unstructured Data

Cost of traditional storage is prohibitive for large capacity

Technology refresh and migration necessary to benefit from

larger disks

Arrays are inefficient at scale

• FC networks are expensive

• RAID is inefficient for large drives

16

Object Storage

17

New Class Of Storage – Object Store

Massively scalable

Rock-bottom cost

Highly Durable

Highly Automated

18

Object Storage Definition

Storage of data that is broken into distinct segments, each containing a unique identifier that allows for retrieval and integrity verification of the data. - Forester

19

Object Store Characteristics

Scalable to multiple petabytes and can store billions of objects

Highly durable and available

Highly elastic

Flat namespace

Built on top of generic hardware

Rich user-defined metadata – helps maintain data context

Eventually consistent

Granular, Object and Bucket level ACL

REST based API access

20

Think of a Coat Check Service

21

Object Store – Logical Representation

Account Bucket BLOB

Operations

Finance

R&D

22

Comparison Block/File and Object Store

23

Object Store – Use Cases

24

Object Storage Use Cases

Backup/Archive

Static Web

Content

Content

Distribution

Next Gen

Apps

Imaging

Data Analytics

25

When is Object Store Not Such a Good Idea?

Traditional workloads that require high performance, low latency

Application that generate data with high rate of updates

Applications that generate random I/O

26

Getting Started With The Object Store: What are my Options ?

Stand up instance of Object Store on-premise

Object Storage-as-a-Service

27

When To Consider Building An Object Store on Premise

Data cannot leave the premise for regulatory reasons

Upfront capital expenditure not a big concern

Expertise and bandwidth available to stand up an Object Store

Fairly predictable storage needs

Infrastructure available in multiple locations for data durability

28

When To Consider Leveraging Cloud Storage

Storage needs unpredictable and bursty

Wish to pay only for storage consumed

Want to leverage economies of scale to lower storage cost

Lack of capex to stand up the storage platform

Data dispersed across different regions, need for data

centralization

Need to free up admin’s time to devote to other higher value

activities

29

Object Store In The Cloud – Adoption on the Rise

30

How to Choose a Cloud Provider

SLA’s attained (not promised)

Vendor lock-in (Can I move my data back on-premise, or another

cloud provider if required)

Does the vendor understand the needs of the Enterprise

• Security

• Purchase process

• Support

31

vCloud Hybrid Service: Extending To The Cloud

VMware vCloud

Hybrid Service

Your Data Center

Any Application… No Changes

Software-Defined

Data Center

VMware vSphere &

vCloud Suite

Existing & New Apps

Seamless Networking

Common management

One Support call

IaaS cloud owned and operated by VMware based on VMware software

32

Summary

Cost effective, durable storage

Efficient for managing large unstructured data sets

Ideal for storing static data

Powerful approach for long term storage

33

Questions?

THANK YOU

VMware Hybrid Cloud –

An Introduction to Object Store

Rachna Thusoo, VMware

Rick Brauen, VMware

PHC5734

#PHC5734