reshaping storage for the next generation datacenter

Accelerate

OpenStack*

Together

* OpenStack is a registered trademark of the OpenStack Foundation

Reshaping Storage for the Next Generation Data Center

OpenStack Summit, Paris, Nov. 3-7, 20142

• Data Explosion & Storage Pain Points

• Software Defined Storage (SDS) vision

• OpenStack SDS Controller Prototype

• Ceph and Virtual Storage Manager

• Fujitsu Hyperscale Storage for OpenStack

• OpenStack Swift

• Summary

Agenda







• OpenStack Swift

• Summary

Agenda


Data Explosion:

From 2013 to 2020, the digital universe will grow by a factor of 10, from 4.4 ZB to 44 ZB

It more than doubles every two years.

Data needs are growing at a rate unsustainable with today’s infrastructure and labor costsSource: IDC – The Digital Universe of Opportunities: Rich Data and the Increasing Value of the Internet of Things - April 2014

… cost challenges continue to grow……….

….data complexity is increasing

…. And DC’s spend 40% of their budget on storage


Storage Pain Points

Storage Silos (Traditional)

• Application mapped to specific appliance

• Storage resources optimized to run specific workload

• Isolated storage resources

Traditional storage management is too complex and inefficient

Challenges

• Cost: silo’d storage solutions

- Data Growth

- Maintenance, Operations & Support

- Infrastructure

• Choice: lock-in

- Vertically integrated solutions

- Flexibility to innovate

• Cloud deployment

- Limited Scalability

- Need for massively shared data







• OpenStack Swift

• Summary

Agenda


Software Defined Infrastructure (SDI)

Orchestration Software PROVISIONING MANAGEMENTOrchestration provisions, manages and optimally

allocates resources based on the unique requirements of an application

POOLED RESOURCESNetwork, Storage and Compute elements are

abstracted into resource poolsStorage Network Compute

Services Delivery

Resource Pool

Orchestration Software

Infrastructure Attributes

Application A

Application B

Application C

Application D

Power Performance Security Thermals Utilization Location

SERVICE ASSURANCEPolicy based dynamic provisioning

App/SLA mapping to underlying Infrastructure

Efficient SDI requires Application Infrastructure interactionServers play a critical role for Compute, Network, Storage, Security, Energy and Manageability


SDS – A Key Component of SDIDynamic, policy-driven storage resource management

Services Delivery

Software Defined Storage Controller

Orchestration Software

Infrastructure Attributes

App #1 App #2 App #3 App #4

Power Performance Thermals Utilization Location

Storage Systems

Latency Durability

SDS is a framework that delivers a scalable, cost-effective solution to serve the needs of tomorrow’s Data Center

Abstracting Software from Hardware, providing flexibility & scalability

Aggregating diverse provider solutions, increasing flexibility and drive down costs

Provisioning resources dynamically (pay-as-you-grow) increasing efficiency

Orchestrating application access to diverse storage systems through Service Level Agreements (SLAs), increasing flexibility and handle data complexity


SDS Architecture

Applications

SDS Controller

Node Node Node

Orchestrator

Storage System[Capacity]

Storage System[Performance]

Data Services

Storage System[SAN]

Storage System[NAS]

SDS Controller• Visibility and Control of

ALL storage resources• Communication between

Apps, Orchestrator and Storage Systems

• Allocates storage resources to meet SLA’s

Node NodeJBOD

Data Services• Application that runs in

DP to optimize storage• Ex: Predictive Analytics• Ex: De-Duplication• Ex: Tiering

……….. ………..

SDS : Consolidated Management of Scale-Out and Scale-Up Storage and plugs into SDI

Compute ControllerSDN Controller

NASSAN







• OpenStack Swift

• Summary

Agenda


SDS Functional Partitioning

Block File Object

Outside world (UI, CLI, Compute, Network

Controllers)

Volume Operations (Control Plane)

Share Operations (Control Plane)

Object Operations (Control Plane)

SDS Controller

Provision

Discover

Compose

Maintain

Data Mgmt

Free Pool

Provision Storage System


SDS Controller – One Control Plane

App (e.g. VM)attach/

detatchvolume

Heat CLIHorizon

Ceilometer

App (e.g. Nova)

Cinder+ Drivers

Storage System

Cinder

SDS Controller(Cinder+)

Discovery, QoS etc.

attach/detatchshare

Manila+ Drivers

Storage System

Manila Manage volumes, Shares, images

Metrics, metering

Object Storage

Object Servers

E.g., Object Storage –Swift, Ceph, Atmos, Amplidata

Get Storage URL

PUT/GET/DELETE account, container, object

App (e.g. Nova)

Glance+ Drivers

Storage System

GlanceProvision volume

App (e.g. Webapp)

Provision Volumes

Manage Volumes

Provision Storage SystemManage PoolsManage Shares

Template mgmt

Provisioning,Maintenance etc.

Provisioning,Maintenance etc.

Work with dev community to identify path to enable SDS Controller natively in OpenStack


SDS Controller Prototype

Provision (Storage System)

Discover (Storage

Capabilities)

Compose (Virtual Pools)

Data Type Life Cycle Mgmt

Maintenance (Storage

Systems, Pools)

• Expand Cluster (Ceph VSM, SwiftStackController)

• Discover storage system, tiers, capabilities - driver framework (Swift, Ceph)

• Deassgin resource• Unprovision resource• Retire storage system

& virtual pools• Support for

maintenance mode

• CUDL volumes & shares• Attach & Detach

volumes & shares• Attach object store• Clone, Snapshot,

Backup, Extend, Shrink• Get volume stats

• QoS monitor, alert & enforce

• Policies, data life-cycle mgmt. automation

• SLO based resource requests, scheduling

• Virtual pools for all operations

• Data service chaining, app assignment

SDS Controller

Note: Operations may be within storage system and among storage systems

Not in Openstack

Exists in Openstack

Legend

CUDL = Create, Update, Delete, List

• CUDL virtual pools• Attach/Detach tiers to

virtual pools• Admin UI for pool

composition• Object supportPrototype Scope

Publish prototype by end of Dec’14 in external git repo







• OpenStack Swift

• Summary

Agenda


Ceph Introduction

An “Open source” distributed storage software that provides object, blockand file storage access

CEPH RADOS Storage Cluster

A Reliable, Autonomous, Distributed Object Store for unstructured data

CEPH Object Gateway

S3 and Swift compatible object gateway

CEPH Block Device (RBD)

Virtual block device for virtual machines and apps

• Ceph is the “only” Open source virtual block storage option. Also provides object, file (experimental)

• Strong customer interest - several production implementations already

KEYSTONE CINDERGLANCESWIFT API NOVA

Qemu/KVM

Intel Focus

• Optimize Ceph block storage for Open stack deployments

• Deliver Open stack and Ceph Reference Architectures

• Lead SDS Controller integration with Ceph (prototype and beyond)


Intel Virtual Storage Manager - Design Goals

Intel Virtual Storage Manager for Ceph16

Consistent Configuration Segregated Storage Support

Efficient Asset Management

• VSM controls cluster configuration through pre-defined manifests

• Operator-selectable configuration options are defined and validated by OEM or System Integrator

• Reduces maintenance and support cost due to customer mis-configuration, “exotic” configurations

• Separate storage assets by function or performance – Storage Groups

• Drives with similar characteristics explicitly identified – no ambiguous discovery

• Capacity utilization and performance tracked by Storage Group

• Manage server lifetime – add and remove storage at unit of server

• Manage device lifetime - repair storage at unit of drive

Familiar Look and Feel

• OpenStack UI schema• “Flat” navigation• Tabular data grouping – minimize drill-

down• Comprehensive one-page summary• Error and Status Reporting


Virtual Storage Manager

Web-based UI Administrator-friendly interface for

management and monitoring

Configuration management Storage Groups aggregate drives with similar

performance Zones aggregate drives within failure domains

Capacity Management Pools segregate allocation by application Capacity utilization by storage group and pool

Cluster Management Manage capacity growth Manage Server & disk maintenance

Cluster Monitoring Capacity and performance OSD, PG, and monitor state

VSM RESTful API Software interface supports automation

17

Management framework = Consistent configurationOperator-friendly interface for management & monitoring


Managing the Cloud Storage System Lifecycle


Dashboard Overview


VSM Open Source Project

Intel Virtual Storage Manager for Ceph20

• Sign up: • Register for access at 01.org and

github.com• Find it:

• At 01.org/virtual-storage-manager

• Get it:• Source and documentation• Apache 2 license

• Contribute:• Join the VSM community and

discussing features. • See 01.org/virtual-storage-

manager for details







• OpenStack Swift

• Summary

Agenda

22 © Fujitsu 2014INTERNAL USE ONLY

ETERNUS CD10000Hyperscale Storage for OpenStack

Dieter Kasper

CTO Data Center Infrastructure,

Emerging Technologies & Solutions, Fujitsu


3rd platform implications challenges for storage

3rd platform – Distributed software-defined scale-out storage

Big Data Analytics/Social Business/Mobile Broadband/Cloud Services

Manageability

Central management

of huge storage

amounts

Unified multi-protocol

access (block, file,

object)

Seamless introduction

of new storage

Reliability

Full redundancy

Self healing

Geographical dispersion

Fast rebuild

Scalability

Practically unlimited

scalability in terms of

performance & capacity

No bottlenecks

No hot spots


ETERNUS CD10000 Principles

Storage

Node

Storage

Node

Storage

Node

Storage

Node

Storage

Node

Storage

Node

pseudo-random distribution

transparent creation of data copies automatic recreation of lost redundancy

automated tech refresh


What is ETERNUS CD10000?

ET

ER

NU

S C

D10000

Block Level

Access

Object Level

Access

File Level

Access

Central Management & SW enhancements

Ceph Storage System S/W

10GbE Frontend Network

Infiniband Backend Network

Perf

orm

ance N

odes

Capacity N

odes

Fujitsu Standard

Hardware

Fujitsu Software

Open Source

Application

Interface

Cinder Swift Manila

EC

Backup

Sync

& Share

Archive

OpenStack APIs

Integrated

Applications


Fujitsu Software Enhancements

Central software deployment

Central network, logfile, and cluster management

SNMP integration of all nodes and network components

GUI for easier deployment, configuration, administration and maintenance

Own Fujitsu Erasure Coding on Roadmap

Still 100% compatible with underlying open source

Integrated Middleware / Applications: Backup, Archive, Sync & Share, ...

http://en.wikipedia.org/wiki/File:Ceph_logo.png

http://en.wikipedia.org/wiki/File:Ceph_logo.png


Virtual Storage Manager

Web-based UI

Configuration Management

Capacity Management

Cluster Management

Cluster Monitoring

VSM API


StorNode

SAS

SAS

SAS

SSD

StorNode

SAS

SAS

SAS

SSD

SAS SAS

SSD SSD

StorNode

SAS

SAS

SAS

SSD

StorNode

SAS

SAS

SAS

SSD

SAS SAS

SSD SSD

PY PY

Block

VMs

Object

VMs PY PY

Block

VMs

Object

VMs

DR Node

(at 3rd site)

Redundant Cluster Interconnect (IP based) Redundant Cluster Interconnect (IP based)

StorNode

SAS

SAS

SAS

SSD

StorNode

SAS

SAS

SAS

SSD

SAS SAS

SSD SSD

StorNode

SAS

SAS

SAS

SSD

StorNode

SAS

SAS

SAS

SSD

SAS SAS

SSD SSD~ 100x

Storage

Nodes

~ 100x

Storage

Nodes

Redundant Client Interconnect (IP based)

ETERNUS CD 10k HA/DR Design



Silver Pool

VolB-1

primary

VolB-2

primary

VolB-3

primary VolB-3

2nd

VolB-2

2nd

VolB-1

2nd

…VolB-3

3rd

VolB-2

3rd

VolB-1

3rd

VolB-3

4th

VolB-2

4th

VolB-1

4th

ETERNUS CD 10k HA/DR Design


PY PY

File

App

Block

App


PY PY

File

App’

Block

App’… …

Gold Pool

VolA-1

primary

VolA-2

primary

VolA-3

primary… VolA-3

2nd

VolA-2

2nd

VolA-1

2nd

VolA-3

3rd

VolA-2

3rd

VolA-1

3rd

Bronze Pool

VolC-3

3rd

VolC-2

3rd

VolC-1

3rd

VolC-1

primary

VolC-2

primary

VolC-3

primary VolC-3

2nd

VolC-2

2nd

VolC-1

2nd

…VolC-3

3rd

VolC-2

3rd

VolC-1

3rd

Class repli=2 repli=3 repli=4 ECode

SSD Gold

SAS Steel Silver

SATA Bronze


ETERNUS Hyperscale SDS versus self-made open source storage

Build open source storage yourself Out of the box ETERNUS Hyperscale SDS

incl. support

I incl. maintenance

ETERNUS "out of the box" hassle-free & maintained hyperscale storage appliance.

Easy Deployment / Management+

E2E Solution Contract+







• OpenStack Swift

• Summary

Agenda


Intel’s Work With The Swift Community

32

• Storage Policies• Framework for extending Swifts capabilities around

durability, performance, geographic segmentation, etc.• Released summer ‘14 as the defining feature for Swift 2.0• Part of Juno Integrated Release

• Erasure Code Support• Builds upon Storage Policies• Community is hard at work targeting Kilo intercept• Design session later this week covering details• Work includes development of a common Python erasure

coding library (PyECLib) with multiple pluggable C modules enabling algorithm choice


What is COSBench?

33

Open Source Cloud Object Storage Benchmarking Tool

Announced at the Portland design summit 2013

Open Source (Apache License)

Cross Platform (Java + Apache OSGI)

Distributed load testing framework

Pluggable adaptors for multiple object storage backends

Flexible workload definition

Web-based real-time performance monitoring

Rich performance metric reporting (Performance timeline, Response time histogram)

Storage backend Authtempauthswauthkeystonedirectnonebasic/digestlibradosrados GW (swift)rados GW (s3)

Amazon* S3 integratedScality sproxydCDMI

CDMI-base basic/digestCDMI-swift swauth/keystone

None noneMock mock

Amplidata* Amplistor

OpenStack* Swift

Ceph

Iometer(block)

COSBench(object)







• OpenStack Swift

• Summary

Agenda


Summary

OEM/ISV Partner Solution Reference Architectures

Work with co-travelers to develop reference architectures to support SDS concepts

Developing an SDS Controller Prototype

Initial open source prototype released Q4’14

Open Source Storage Software

Ceph, Swift

Virtual Storage ManagerSimplified Management Tool for Ceph – open sourced Q4’14


Backup Slides


SDS Controller Use Case: Application Assignment

SDS Controller

$$$ Gold

$$ Silver

$ Bronze

1

2

Database

Discover

Compose

3 Assign

Backup

Content Sharing

Storage System

[Distributed]

Storage System 1

[SAN]

Storage System[NAS]

Storage System

[Distributed]

Storage System

[Distributed]

IOPS – 10K(DC1)

IOPS – 5K(DC2)

Tpt – 100Mbps(DC2)

Tpt – 50 Mbps(DC1)

Tpt – 5 Mbps(DC1)


SDS Controller Use Case: Storage Overflow

Storage System

[Distributed]

Storage System 1

[SAN]

Storage System[NAS]

Storage System

[Distributed]

Storage System

[Distributed]

IOPS – 10K(DC1)

IOPS – 5K(DC2)

Tpt – 100Mbps(DC2)

Tpt – 50 Mbps(DC1)

Tpt – 5 Mbps(DC1)

Free Server Pool

81%UtilizationApp 1

SDS Controller

2 Monitor 3 Assign

1

Policies

App


SDS Controller Workflow

Provision (Storage System)

Discover (Storage

Capabilities)

Compose (Virtual Pools)

Data Type Life Cycle Mgmt

Maintenance (Storage

Systems, Pools)

• Assign resource• Provision resource

• Discover storage system, tiers, capabilities

• Discover QoS

• Deassgin resource• Unprovision resource• Retire storage system

& virtual pools• Support for

maintenance mode

• CUDL volumes & shares• Attach & Detach

volumes & shares• Attach object store• Clone, Snapshot,

Backup, Extend, Shrink• Get volume stats

• QoS monitor, alert & enforce

• Policies, data life-cycle mgmt. automation

• SLO based resource requests, scheduling

• Virtual pools for all operations

• Data service chaining, app assignment

SDS Controller

Note: Operations may be within storage system and among storage systems

Not in Openstack

Exists in Openstack

Legend

CUDL = Create, Update, Delete, List

• CUDL virtual pools• Attach/Detach tiers to

virtual pools• Admin UI for pool

composition• Object support


SOFTWAREDEFINED STORAGE

REFERENCEARCHITECTURES

SOFTWARE ECOSYSTEM

PROCESSOR PLATFORMS

Intel®

QuickAssistTechnology

NETWORKING AND FABRIC

SSD’S AND NVM

Intel® CacheAcceleration

Software

Intel® Storage Acceleration

Library (ISA-L)

Intel® Data Plane Development Kit

How can Intel help you get on the path to SDS?


Solution Reference Architectures (SRA’s) to drive Proof-Of-Concepts (POC’s)

• WHY?• Reduce time to evaluate and get started - Low investment to implement a solution• Test a proven E2E SDS solution that solves a critical customer problem and works NOW• Quick Training for your team to get up to speed on new technology

• HOW?• Identify a problem that SDS can address• Work with Intel to select a Solutions Reference Architecture (SRA) to test• Intel will deliver the SRA which will include

• White Paper (in all SRA’s)• Fully Configured Systems w/ SW (in some SRA’s)• Resources to get it up and running (in some SRA’s)

• Use the SRA to Implement a Proof-Of-Concept (POC)• Drive results of the POC into Production


Solutions Reference Architectures (SRA’s) - WIPUsage Models HPC File

Consolidation, Object Store

Cold Storage Block Consolidation, Object Storage

File Consolidation,

VDI, E-Mail, Virtualization

VDI, E-Mail, Virtualization

File Consolidation, Image store

Capabilities / Use cases

HPC storage at Exascale

Enterprise File Share using Object Store with Erasure Code as the back-end

VDI, File Share with in-line de-dupe and compression

OpenStack cloud, High-performancestorage with caching

File sharing, content cloud, high-performance for large data sets

VDI, Tier 2/3 test/dev with compute and storage on the same nodes

VDI, Tier 2/3 test/dev, remote office, disasterrecovery with compute and storage on the same nodes

Scalable automated management Storage automation tools & cloud stacks

OperatingEnviron. / Orchestration

S3 I/F or NFS S3 I/F or CIFS/NFS

OpenStack VMware

VM/OS OpenZFS/ Linux

---- agnostic agnostic RHEL/KVM ESX/vSphere ESX/vSphere ESX/vSphere

SDS Controller ---- ---- ProphetStor ProphetStor ---- ---- --- EMC VIPR

Storage System

Lustre Amplidata + Maginatics

Nexenta CEPH RH Storage, Cinder, Swift

VMware Virtual SAN

Maxta MxSP VirtualSAN

TBD

Intel Technologies

Xeon®ISA-L10GbESSDsStorm Lake

Xeon®Atom™ C2000ISA-L10GbESSDs

Xeon®ISA-L10GbESSDsPCSD



Xeon®10GbESSDs


Xeon®ISA-L10GigESSD

reshaping storage for the next generation datacenter

Documents