data center evolution: hyperscale vs. enterprise architectures · keynote 11 data center evolution:...

Keynote 11Data Center Evolution:Hyperscale vs. Enterprise ArchitecturesVal BercoviciCloud and Big Data CzarNetApp, Inc.

@valb00

2015Santa Clara, California

Science (Fiction?)

2 © 2015 NetApp, Inc. All rights reserved.

Exponential Growth of Computing20th Through 21st Centuries

URL: http://www.singularity.com/charts/page70.html

http://www.singularity.com/charts/page70.html

3

Analytics

Competitive advantage463%

Cloud

of CIOs indicate that cloud is one of their Top 5 priorities3

60%

Social

productivity increase125%

Mobile

of the world’s population have a mobile device2

75%© 2015 NetApp, Inc. All rights reserved.

SSOCIAL

MMOBILE

AANALYTICS

CCLOUD

NoSQLNewSQL

OLTP Enterprise Hyperscale Emerging

Application

Data Model

BlockFile

Key-Value Store

Columnar,Document,

Graph

Streaming,Resource Mgmt

at Scale

Evolving Application Architecture Landscape


© 2015 NetApp, Inc. All rights reserved.

Product CatalogDocument Store

Financial Transactions

Relational StoreShopping CartKV Session

Store

AnalyticsColumn Store

Product ImagesObject Store

User SessionsKV Store

Personalized Recommendations

Graph Store

Shift from a one-size-fits-all paradigm

to specialized, best-of-breed data stores

Sample Polyglot App

5

Unintended Consequences

6

Data Management Ramifications

Supply Chain Trends

SMAC


SSOCIAL

MMOBILE

AANALYTICS

CCLOUD

Economics Driving Polarization of Storage

7

Access Latency

$$$

SLCeMLC

MLCTLC

SCM

Solid State95% R / 5% W

Cloud

Archive

HDD1% R / 99% W

DRAM

TAPE

EntDrive

Performance Capacity


Google Quarterly Spend $3.5BYearly Spend $14B

All?Yearly Spend $50B<

3D

Storage Intelligence 1.0

Storage Intelligence

1.0

T10 T13

“NetApp selected Samsung solid-state drives to bring enterprise-grade performance and capacity to a customer base that also expects the cost effectiveness of V-NAND TLC flash. The combination of NetApp Clustered Data ONTAP software value with Samsung hardware component expertise has helped the NetApp All Flash FAS array become the fastest growing product in NetApp history.”

– Lee Caswell, VPProduct and Solutions Marketing

NetApp, Inc.© 2015 NetApp, Inc. All rights reserved. 8

New Memory / Storage Tiers

© 2015 NetApp, Inc. All rights reserved. 9

NVM/Persistent Memory Programming Model – pmem.io

10

Hardware

Kernel

User

NVM Driver

Optimized Applications

Naming Layer

Open NVM Kernel API

NVM Management NVM User-space API

NVM Hardware

Block Layer

Middleware (e.g. JVM)

Raw Access

File Access

File File or Raw Access

Management Applications

(GUI, CLI, CIM)

File System

File Access

NVM Customer Kernel Modules

Control Path

Data Path

Standard Access NVM Regions Exposed as Files NVM API


http://pmem.io/

Management in the SCM Data Path: Latency Rules

11

NFS/Block/LRSE

AFF Cluster

Server-side Persistence Store Server

Application

Data Model

SCM DriverOperating System

HypervisorServer-side Persistence Store

Server

Application

Data Model


Hypervisor

Server

Application

Data Model


Hypervisor

Server

Application

Data Model


HypervisorServer-side Persistence Store Server-side Persistence Store

OnCommand.Next


New Data Center Storage Stack Circa 2020

12

XaaS

DataNode

DataNode

DataNode

DataNode

DataNode

ComputeNode

ComputeNode

ComputeNode

ComputeNode

ComputeNode

Distributed/Parallel Processing

Host CacheSoftware

Mem Mem RDMA (iWARP/RoCE) SCM

Independent Scaling

1 μsec

Shared Storage (POSIX + Object)

Data Globally Managed by

Federated/Shared Storage

Persistence/Intelligent Caching Layer



Waterfall “Lean Cloud” (Enterprise & Hyperscale)Lifecycle ComparisonsApp/Container lifecycle placement tomaximize hybrid cloud economics

Summary: Cloud Landscape Since 1/1/2012

The BVP Cloud IndexBessemer Venture PartnersAugust 2015

14

Source: Gartner, July 2013Note: Estimates per 2013. Cloud includes SaaS, PaaS and IaaS. Overall IT includes worldwide spend in Data Center Systems, Enterprise Software and IT Services.

Cost of Cloud Price Index Specification Over Timen = Market Weighted Average of 70% of Market

Cloud Price Index, 451 Research, July 16, 2015

© 2015 NetApp, Inc. All rights reserved. 15

LoB Tech Spend

2014

Enterprise Technology Spend Ratios

16

IT Budget

66%

2008

Run

20%

Grow


14%

Transform

Tech Spend Mapped to Project Lifecycles

Transform14%

Grow20%

Run66%


Application Lifecycles

Dev/TestLab

Deploy/ScaleNew Infrastructure

MaintainLegacy Infrastructure


19

Amazon Web Services IaaS (Storage) Deployments: Analysis and Insight IDC #255387April 2015

Economics of a Hybrid Cloud Ecosystem

HyperscaleAWS, Azure,GCE, Aliyun

(M)SPVerizon, T-Systems,

Telstra, HP, Rackspace

Hosting/On-Premise

GoDaddy, Dreamhost

20

LowerProduction

Costs

Burst forPeak

Workloads

HostStatic

Workloads© 2015 NetApp, Inc. All rights reserved.

Scale-Up Scale-Out In-Memory

New Resource Managers and Control Points


Converged

HCI / RSA

Redis / Tachyon

Spark / FlinkSwift / Riak

HDFS / CEPH

OpenStack / Mesos / YARN / Kubernetes

Storage

Persistence

Infrastructure

Management

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&docid=buNV4Ct9obmwxM&tbnid=JNTK58H6XPJyOM:&ved=0CAUQjRw&url=http://en.wikipedia.org/wiki/NetApp&ei=Nt8EU7e-DsGGogSBmIHYAg&bvm=bv.61535280,d.cGU&psig=AFQjCNHjbuJgIjwHplEkzHv9Z3KJV6tbeg&ust=1392914307857030


Architecture Biases: Today

22

Hyperscale

(M)SPHosting/On-Premise


Scale-Up Scale-OutScale-Up

Storage

Persistence

Infrastructure

Management

Scale-Out





Architecture Biases: Tomorrow

23

Hyperscale

(M)SPHosting/On-Premise


In-Memory

Scale-Up

Scale-Out

Storage

Persistence

Infrastructure

Management

Scale-UpScale-Up






Thank You

data center evolution: hyperscale vs. enterprise architectures · keynote 11 data center evolution:...

Documents