future cloud infrastructure

Val Bercovici

Cloud & Big Data CzarNetApp

Future Cloud Infrastructure

Science, or Science Fiction?

Val Bercovici@valb00

What I hope to accomplish today...

&

...and avoid this.

CTO Research Themes

Software

Defined

Networks

Cloud – New Infrastructure Control Point

CTO Research Themes

Software

Defined

Networks

Wither POSIX? Capacity Trends(RAID Object RAID Erasure Coding)

S3

Swift

CDMI

CTO Research Themes

Software

Defined

Networks

Wither ACID? (Big) Data Trends

CTO Research Themes

Software

Defined

Networks

Wither OSI? Networking Trends

Software

Defined

Networks

“Intel Watching” - Interconnects

13NetApp Confidential - Internal Use Only

From EE Times: Cray sells interconnect hardware unit to IntelSylvie Barak 4/24/2012 6:34 PM EDT

MOUNTAIN VIEW, Calif.--Supercomputer maker Cray Inc. has signed a definitive

agreement to sell its interconnect hardware development program and related

intellectual property to Intel Corp. for $140 million in cash.

Intel buys Infiniband unit from Qlogic for $125M

Associated PressAssociated Press – Mon, Jan 23, 2012

SANTA CLARA, Calif. (AP) — Intel Corp. on Monday said it had agreed to buy Qlogic Corp.'s line of

Infiniband adapters, used to tie processors together into supercomputing clusters, for $125 million.

Intel said the acquisition would help it reach the goal of supplying computers that can perform one

exaflop, or a quintillion calculations, per second. The Santa Clara, Calif.-based company expects a

"significant number" of Qlogic employees to accept offers to join Intel.

Intel to Acquire Fulcrum Microsystems

Posted by IntelPR in News Stories on Jul 19, 2011 7:55:32 AM

SANTA CLARA, Calif., July 19, 2011 – Intel Corporation today announced it signed a definitive agreement to acquire

Fulcrum Microsystems Inc., a privately held fabless semiconductor company that designs Ethernet switch silicon for

data center network providers.

―Intel is transforming from a leading server technology company to a comprehensive data center provider that offers

computing, storage and networking building blocks,‖ said Kirk Skaugen, Intel vice president and general manager,

Data Center Group.

2001 2010 2014 2017

Ethernet 1Gb/s 10Gb/s 40Gb/s 100Gb/s

Infiniband 10Gb/s 40Gb/s 104Gb/s ??

10x 4x 2.5x

Wither InfiniBand? Networking Trends

Future Networks? EthernetPCIMemory

CTO Research Themes

Software

Defined

Networks

Performance – Storage Class Memory

(SCM)

Revolution from Above, not Below

18

1M

100K

10K

1K

100

10

1

Why SCM will need new Interconnects

Assume 50ns SCM access time (DRAM speed)

PCIe, InfiniBand latency ≈ 1 μsec = 21x latency

Read syscall, file in RAM ≈ 260 nsec = 6x latency

Speed of light in optical fiber ≈ .65 ft / nsec

20

+

5’ server

rack

5 ft = 15nsec = 1.3x latency

10 ft = 30nsec = 1.6x penalty

+40 ft = 120nsec = 3.4x penalty

storage

appliance

Replicated Software Transactional Memory

(STM)

21

Host Networked Storage

Replication

of transaction log

for reliability

and D/R

Application

STM library

transactionalmemory

DRAM/SCM

hypervisor/kernel

transaction logprocessed into

efficientsnapshot

storage

streaming protocol

transaction

manager

TECH 2009-2011 2012-2015 2016-2020

PCM

128Mbit 90nm (Omneo)

512Mbit 65nm

(in mobile handsets)

1Gbit 45nm (Bonelli)

8Gbit 20nm (ISSCC „11) Hynix/IBM 40nm 1Gbit

ReRAM

180nm Evaluator Kit in 2012

Mass-production in 2013/14

30nm 1Gbit in 2013/14

STT-MRAM

16Mbit 130nm MRAM

(SRAM replacement)

130nm SRAM replacement 4Gbit chip with LPDDR2 i/f in ‟16

Expected to compete

with DRAM/Flash

SCM Roadmap Speculation

22

Historical Context

http://antranik.org/using-moores-law-to-predict-future-memory-trends/

Science (Fiction?) http://www.singularity.com/charts/page70.html

IBM Watson – Circa 2010!(SCM + Fast Interconnect + Hadoop)

http://en.wikipedia.org/wiki/Watson_(computer)