Memory-DrivenComputingA story about The Machine and Gen-Z

What is the motivation?

2

The New Normal: Compute is not keeping up

3

Data(Zettabytes)

Data nearly doubles every two years (2013-2020)

Data growth

Transistors(thousands)

Single-threadPerformance(SpecINT)

Frequency(MHz)

Typical Power(Watts)

Number of Cores

Microprocessors107

106

105

104

103

102

101

100

The past 60 years

4

1950s 1960s 1970s 1980s 1990s 2000s Today

It’s time to rethinkhow computers are built

RDBMS

httpd

Memory-Driven Computing

5

SoC SoC

SoCS

oC

SoC

SoCSoC

SoC

SoC

SoC

SoC

SoC

MemoryMemory

Mem

ory

Mem

oryM

emory

Memory

MemoryMemory

Mem

ory

Mem

ory

Mem

ory

Memory

Memory-DrivenComputing

Processor-Centric ComputingMemory

+Fabric

Customize the hardware to the workload

7

Special Purpose Compute

Reduced costLess energyLess spaceLess complex

GPU DSP

x86A

SIC

Phot

onic

Neuro

Quantum

POWER

SPARC

RIS

CV

ARM

FPGA

Memory

8

Q: How do we get to Memory-Driven

Computing?

The Machine Program: Memory fabric testbed

9

HPE demonstrated the world’s first Memory-Driven Computing architecture: Major milestone for The Machine project

10

On Nov 28, 2016, we announced the fundamental building blocks of the new architecture are working together demonstrated…

• Compute nodes accessing a shared pool of Fabric-Attached Memory;

• An optimized Linux-based operating system (OS) running on a customized System on a Chip (SOC);

• Photonics/Optical communication links, including the new X1 photonics module (our chip for optical transmission) are online and operational;

• New software programming tools designed to take advantage of abundant persistent memory.

Nod

e

Switch

11

4TB Fabric-attached memory

Fabric-attached memory

Fabric-attached memory

Fabric-attached memory

Fabric-attached memory

Fabric-attached memory

Fabric-attached memory

SoC256GB DRAM

SoCDRAM

SoCDRAM

SoCDRAM

SoCDRAM

SoCDRAM

SoCDRAM

Fabric Switch

Switch

Switch

Switch

Switch

Switch

Switch

Transform performance with Memory-Driven programming

In-memory analytics

15xfaster

New algorithms Completely rethinkModify existing frameworks

Similarity search

20xfaster

Financial models

8,000xfaster

Large-scalegraph inference

100xfaster

12

The Emulated Machine The Simulated Machine The Machine

Hardware/Software co-development

Hardware development

Software development

13

The Machine DistributionSoftware stack for Memory-Driven Computing

Machine (Prototype) hardware

The Machine Distribution

Node Operating System

Persistent Memory Library

(pmem.io)

Librarian File System (LFS)

Fabric-attached memoryatomics library

Linux (L4TM)

Example Applications

ManagementServices

Librarian

Data Management & Programming FrameworksManaged data

structuresSPARKLE

Emulation/Simulation ToolsPerformance

emulation for NVMFabric attached

memory emulation

X’86 emulation hardware Open sourced components

Fault-tolerant programming

Fast optimistic engine

Programming and analytics toolsOperating system supportEmulation/simulation tools

14http://www.labs.hpe.com/research/themachine/TheMachineDistribution

What are core Memory-Driven Computing components?

15

Combining memory and storage in a stable

environment to increase processing speed and

improve energy efficiency

Using photonics where necessary to eliminate

distance and create otherwise impossible topologies

Optimizing processing from general to specific tasks

Radically simplifying programming and enabling

new applications that we can’t even begin to build today

Fast, persistentmemory Fast memory fabric Task-specific

processing New software

MDC drives new computer scienceOne architecture scales from the dense data center to the intelligent edge

16

Memory Abundance

– Similarity search– Search space optimization– Financials futures modeling

Non-volatilityof Memory

– Scalable transactional key value stores

– Managed data structures– Energy scalability and retention

Memory shared withjust the right compute

– Spark in-memory Hadoop– Deep neural net training– Network function virtualization

Dynamic Range

– Memory-Driven Computing edge

– Consistent node, enclosure, rack, row, data center

Memory-Driven Computing

Photonic fabrics destroy distance

17

Photonics

Hundreds of racks can behave as a single server

= 4096 yottabytes292bytes

High BandwidthLow Latency

Advanced workloads & technologies

CompatibleEconomical

Gen-ZA new data access technology

Open Standard

I/O

Accelerators

FPGA GPU

CPUs

SoC SoC GPUFPGA

MemoryMemoryMemory Memory

Pooled Memory Network Storage

Direct Attach, Switched, or Fabric Topology

18

Gen-Z – Interconnect for Fabric Attached Memory

I/O

Accelerators

FPGA GPU

CPUs

SoC SoC GPUFPGA

MemoryMemoryMemory Memory

Pooled Memory Network Storage

19

Gen-Z – Interconnect for Messaging

I/O

Accelerators

FPGA GPU

CPUs

SoC SoC GPUFPGA

MemoryMemoryMemory Memory

Pooled Memory Network Storage

20

Gen-Z – Interconnect for Composable IO

I/O

Accelerators

FPGA GPU

CPUs

SoC SoC GPUFPGA

MemoryMemoryMemory Memory

Pooled Memory Network Storage

21

Industry collaboration on interconnect technology

Industry leaders developing anext generation, memory-semantic interconnect

22

For more resources on MDC & The Machine

23

Overview − The Machine www.hpe.com/themachine− The Machine news room https://www.hpe.com/us/en/newsroom/news-archive/feature/2016/06/The-Machine-Discover.html − Memory-Driven Computing https://www.labs.hpe.com/next-next/mdc

Articles and important announcements− Adapting to Thrive in a New Economy of Memory Abundance

https://www.labs.hpe.com/pdf/IEEE_Adapting_to_Thrive_in_a_New_Economy_of_Memory_Abundance.pdf − HPE Demonstrates World’s First Memory-Driven Computing Architecture

https://www.hpe.com/us/en/newsroom/news-archive/press-release/2016/11/1287610-hewlett-packard-enterprise-demonstrates-worlds-first-memory-driven-computing-architecture.html

− The Data Center of the Future, Here Today https://www.hpe.com/us/en/newsroom/news-archive/featured-article/2016/11/The-Data-Center-of-the-Future-Here-Today-Technologies-from-The-Machine-Program-Drive-Hybrid-Infrastructure-Portfolio-and-Future-Innovations.html

Technical articles− Drilling Down Into The Machine From HPE https://www.nextplatform.com/2016/01/04/drilling-down-into-the-machine-from-hpe/ − The Intertwining Of Memory And Performance Of HPE’s Machine

https://www.nextplatform.com/2016/01/11/the-intertwining-of-memory-and-performance-of-hpes-machine/ − Weaving Together The Machine’s Fabric Memory https://www.nextplatform.com/2016/01/18/weaving-together-the-machines-fabric-memory/ − The Bits And Bytes Of The Machine’s Storage https://www.nextplatform.com/2016/01/25/the-bits-and-bytes-of-the-machines-storage/ − Non Volatile Heaps And Object Stores In The Machine https://www.nextplatform.com/2016/02/08/non-volatile-heaps-object-stores-machine/ − Operating Systems, Virtualization, And The Machine https://www.nextplatform.com/2016/02/01/operating-systems-virtualization-machine/ − Future Systems: How HP Will Adapt The Machine To HPC

https://www.nextplatform.com/2015/08/17/future-systems-how-hp-will-adapt-the-machine-to-hpc/ − Spark on Superdome X Previews in-memory on The Machine

https://www.nextplatform.com/2016/04/11/spark-superdome-x-previews-memory-machine/