1040: openpower foundation update

OpenPOWER Overview

September 2015

John AshleySenior IBM Developer Relationship Manager, [email protected]

© 2015 OpenPOWER Foundation© 2015 OpenPOWER Foundation

© 2015 OpenPOWER Foundation2

What is OpenPOWER?


• Moore’s law no longer

satisfies performance gain

• Growing workload

demands

• Numerous IT consumption

models

• Mature Open software

ecosystem

OpenPOWER, a catalyst for Open Innovation

• Rich software ecosystem

• Spectrum of power

servers

• Multiple hardware

options

• Derivative POWER chips

OpenPOWER is an open development community,

using the POWER Architecture to serve the evolving needs of customers.

Performance of

POWER architecture

amplified capability

Open Development

open software, open hardware

Collaboration of

thought leaders

simultaneous innovation,

multiple disciplines

Feeds back … resulting in client choice

3

New Open InnovationMarket Shifts


In the beginning


Fueling an Open Development Community


The road

ahead

AugustAnnounced intent to form OpenPOWER

DecemberIncorporated Foundation and elected officers;5 members

AprilPublic launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan26 members

JulyIBM, with contributions from Google, released 420,000 lines of firmware code44 members

OctoberMultiple offerings available from Altera, Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan70 members

OctoberChina government endorsed OpenPOWER ecosystem through formation of the China Power Technology Alliance

• Collaborative solutions, standards, and reference designs available• Independent members solutions and systems• Sector growth in technical computing and cloud• Global growth with increasing depth in all layers• Broad adoption across hardware, software, and end users

NovemberDepartment of Energy chose OpenPOWER design for $325M supercomputing contract; Nallatech CAPI developer kit released77 members

2013 2014

DecemberRackspace declares Open Compute, OpenPOWER strategy; Seven work groups chartered84 members

MarchFirst OpenPOWER Summit• 50+ member presentations

and solution demos• 15 hardware reveals• 100+ member projects 112 members

MarchSoftLayer announces first OpenPOWER bare metal as a service offering

2015

Amazing member engagement with incredible progress

MayChartered nine work groups, major HPC deals to be announced; Member solutions promoted at 6k attendee Edge event, announced systems now available130 members

JuneAnnounced £313m UK collaboration with STFC; China Cloud Computing Conference; First China OpenPOWER Summit, 630+ attendees136+ members


Where is the platform going?


IBM and Partner collaboration on OpenPOWER Roadmap

2015 2016 2017

POWER8

POWER8+

POWER9

OpenPowerCAPI Interface

NVLink

Enhanced CAPI & NVLink

Connect-IBFDR Infiniband

PCIe Gen3

ConnectX-4EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4

MellanoxInterconnect Technology

IBM CPUs

NVIDIA GPUsKepler

PCIe Gen3Volta

Enhanced NVLinkPascalNVLink

IBM Systems


New Chips &

Components

Components

& Systems

New Systems &

Platforms

Bringing It

All Together

First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (mock-up)

First GPU-accelerated OpenPOWER developer platform

Prototype of a new high-performance server on the path to exascale

First commercially available OpenPOWER serverRedPower, the first China OpenPOWER

2-socket system coming in 2015 Inspur 2-socket POWER8 Server

ChuangHe China-branded OpenPOWER system with POWER8

Data Engine for NoSQL with 40TB CAPI-attached flash

Open Source Redis

Clustering 192 Vcores + CAPI

40TB in 2U

First China “local” POWER derivative chip, CP1Convey’s CAPI developer kit based on the company’s Xilinix-based co-processors

DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU

First commercially available OpenPOWER third-party server

New CAPI-based solution: the ConnectX-4 adapter card by Mellanox

Nallatech’s OpenPOWER CAPI Developer Kit

24:1 Server consolidation for 3x lower cost per user


First OpenPOWER Developer System

• Single socket ATX form factor board, BMC based evaluation board

• Service subsystem identical to x86

• Reference System for ISV application and OpenPOWER partners

• OpenPOWER Software Stack


OpenPOWER Work Group Roadmap

2014 2015 2016

Developer Platform

System SW

HW Architecture

Accelerator

Compliance

Proposed Work Groups Integrated Solutions

Pers Med

SP010 – Tyan OpenPOWER Customer Reference System

CAPI – Coherent Accelerator Processor Interface

AFU – Accelerator Function Unit

FSI – Field Replaceable Unit (FRU) Service Interface

25g IO Compatibility

Memory

OpenPOWER I/O

9 Work Groups

CharterCompliance SpecificationDraft Review WG Spec

CompSTD

Charter

OpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch

OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch

CharterP8 SP010Data

P8 2U2SReference

P8+ 1U1SReference

P8+ 2U2SReference

OPMB Intf. Spec V1Charter

CharterCAPI AFU Intf Spec V1

OpenCL SDK

CAPI AFU Intf Spec V2

Charter

CAPI LinuxSDK

64b ABIPlatform Ref

Sys I/O Enablement GuideCharter

Charter 25g IO Spec

OPMB – OpenPOWER Memory Bus

ABI – Application Binary Interface

FSI Specification FSI SpecCharter

SDK – Software Developer Kit


Engage in the OpenPOWER community

AC

TIO

NO

UT

CO

ME

INT

ER

ES

T

Technology and

Software Innovators

Discuss areas of

collaboration and synergy

in OpenPOWER.

Sign up for membership

and join a work group.

Build technical and

business relationships.

Developcollaborative innovations

with compelling value

Innovators, Integrators,

and Partners

Deep understanding of

workload demands and

consumption preferences

of end users.

Team with innovators and

end users to drive

requirements, engage in

specific projects.

Delivercollaborative innovations


End Users

Strategic imperatives and

workload demands for

performance and cost

optimization.

Require open software

and systems with choice

and flexibility.

Engage directly on

system design options.

Deploy collaborative innovations



According to results shared at the STAC Summit on June 4, an IBM Power8-based system server delivered more than twice the performance of the best-in-class x86 counterpart when running a set of standard financial industry benchmarks. - HPC Wire

“Both the current results and future potential are so promising that we are

preparing to build an OpenPOWER-based, Open Compute platform.

And it will run OpenStack services. - Aaron Sullivan, Senior Director &

Distinguished Engineer, Rackspace

We estimate that a physical Power Systems server can support twice as many virtual environments – and therefore double the number of client systems – as a physical x86 server. -Ubuntu

“The $320 million deal [U.S. Department of Energy's Sierra and Summit supercomputers] is a validation of sorts of IBM’s recent strategic shift to open up its POWER computing architecture for license and use by other companies looking for alternatives to an Intel-controlled world. - Forbes

“While other vendors are struggling to establish themselves in China,

IBM seems to have found the secret with OpenPOWER. Not only

does this seem to be cementing IBM inside the tough Chinese

technology market but the benefits, such as SuperVessel, are now

starting to be felt

across the whole of IBM.

- Enterprise Times

I still see the POWER8 processor as one of the most

powerful processors in the industry – and with the

accelerators being developed in the OpenPOWER

ecosystem, it is going to be hard for other processors

(including Intel and ARM silicon) to match some of the

acceleration speeds that will be achieved by POWER8

and successive generations. - Clabby Analytics

People Can't Stop Talking About OpenPOWER

“

“

“

“People ask me if we would switch to Power, and the answer is

absolutely,” Urs Hölzle, Google, said emphatically and unequivocally.

“Even for a single generation.”

- The Platform

““The architectures of the last fifteen or more years are clearly not

going to take us past the next several years, so there needs to be a

step change and there are lots of options but for the workloads we’re

looking at ahead, we are confident about this architecture. - Cliff

Brereton, STFC

http://www.hpcwire.com/2015/06/09/ibm-power8-outperforms-x86-on-stac-benchmarks/

http://www.rackspace.com/blog/openpower-opening-the-stack-all-the-way-down/

https://insights.ubuntu.com/2015/06/09/teuto-net-uses-ubuntu-to-bring-ibm-power8-to-the-public-cloud/

http://www.forbes.com/sites/bruceupbin/2014/11/14/ibm-signs-320-million-supercomputing-deal-with-dept-of-energy/

http://enterprisetimes.co.uk/supervessel-open-access-cloud-for-openpower/

https://joeclabby884.wordpress.com/2015/03/24/openpower-foundation-progress-report-from-gtc-2015/

http://www.theplatform.net/2015/04/29/google-will-do-anything-to-beat-moores-law/


Solutionsmaking a difference!


Application Benchmarks


• 50 IBM Innovation Centers

• Compelling PoCs

• Support for little endian applications

Over 1,600 Linux ISVs developing on Power

Big Data & Machine Learning

Cloud Mobile Enterprise

Major Linux Distros

HPC

miniDFT

CTH

BLAST

Bowtie

BWA

FASTA

HMMER

GATK

SOAP3

STAC-A2

SHOC

Graph500

Ilog

CHARMM

GROMACS

NAMD

AMBER

RTM

GAMESS

WRF

HYCOM

HOMME

LES

MiniGhost

AMG2013

OpenFOAM


Compelling solution performance on Power

Data Engine for NoSQL with Redis Labs

• POWER8 + CAPI FLASH as RAM

• 24:1 server consolidation

• Up to 3x lower TCA

Turbo LAMP on Linux on Power

• Next generation integrated LAMP stack

• Accelerated Dev/Ops for Mobile Apps

• 53% less $$ per user / hour with Magento running on Turbo LAMP

MariaDB on Linux on Power

• Up to 2.2x better per core performance

• Up to 1.9x better per system performance

SAP HANA on Linux on Power

• Designed for mission critical 7X24 Enterprise customer operations

• Outstanding throughput per core

• Virtualization out of the box

Veristorm Data Integration & Open

Source Apache

• ETL warehouse data & x86 Hadoop data into Linux on Power Hadoop clusters

• Run Open Source Apache Hadoop optimized for faster insights


• In-memory distributed database using GPUs for processing

• Order of magnitude gains:

• Performance over CPU solutions

• Power reduction

• Cost savings

• Anticipate order of magnitude gains with POWER based NVLink solutions in 2016

GPUdb in-memory Accelerated Database

Ultrafast ingest and analysis of billions of objects


10x higher throughput, 10x lower

latency accelerating NoSQL workloads

PHP (Zend)

PHP (Zend)

Linux (Ubuntu)

Apache Web Server (Ubuntu)

MariaDB (MariaDB)

PHP (Zend)

Orc

hestra

tion

-Juju

(U

buntu

)

High Speed Data Transfer (Mellanox)

Turbo LAMP Stack for mobile and web apps

Future

Turb

o L

AM

P

Dramatically less data center infrastructure

Dramatically faster responsiveness to customers


• Accelerated appliance with novel data-flow implementation of Memcached

on FPGA.

• Up to 36x improved performance and power response times in

microsecond range.

• CAPI integration of memory allows both host memory and coherent-

attached flash to be used as value store.

Up to 36x performance improvementfor Key-Value Store acceleration


Data Engine for NoSQL with 40TB CAPI-attached flash

Load Balancer

500GB Cache

Node

10Gb Uplink

POWER8 Server

Flash Array w/ up

to 40TB

After: NoSQL POWER8 + CAPI Flash

WWW

10Gb Uplink

WWW

Backup Nodes

500GB Cache

Node500GB Cache

Node500GB Cache

Node500GB Cache

Node

Before: NoSQL in memory (x86)

24U4U

Less is More

24:1 physical server consolidation =

6x less rack space

24:1 server consolidation

3xlower cost per user


Best-in-class ingredients • IBM POWER8

• IBM Java

• NVIDIA CUDA GPU acceleration

• Ubuntu Little Endian Linux for POWER

8x performance

improvementGPU acceleration for Java on

segmentation using accelerated machine

learning for clustering with Hadoop / Mahout


50x faster insights with POWER8

systems designed for Big Data and BLU

POWER8 Scale-out Systems

Power S824

Power S822L

Power S824L

Power S822

24:1 server footprint

reduction through CAPI Flash

for BD&A – no SQL

5x Watson scaling through

Software Optimization and

POWER8 for Cognitive

Non-disruptiveApplication mobility from

P6/P7 to P8

65% Guaranteed system

utilization without application

degradation

8x IBM Java advantage through

NVIDIA GPU acceleration

4x reduction in storage

through GPFS and compression

for BD&A - Hadoop

10x ops/sec via Mellanox

Fabric exploitation for Data-

centric workloads


IBM, Mellanox, and NVIDIA awarded

$325M U.S. Department of Energy’s Super Computer bids

Two super computers for Oak Ridge and

Lawrence Livermore Labs in 2017. Sequoia (LLNL)

2012 - 2017

Mira (ANL)

2012 - 2017Titan (ORNL)

2012 - 2017

Current DOE Leadership Computers

5x – 10x Higher Application Performance versus Current Systems

>100 PF, 2 GB/core main memory, local NVRAM,

Mellanox EDR 100Gb/s InfiniBand, IBM POWER CPUs, NVIDIA Tesla GPUs

© 2015 OpenPOWER Foundation25 https://www.stfc.ac.uk/3583.aspx

£313 million collaboration to boost Big Data research in the UK

The research programme will leverage OpenPOWER high performance computing

innovations to enable complex analytics on massive amounts of data.

IBM contributions

• Latest data-centric and cognitive computing technologies,

including ‘Watson’ cognitive computing platform

• 24 IBM researchers to be based at the Hartree Centre

• Joint commercialisation of intellectual property produced in

partnership with STFC

https://www.stfc.ac.uk/3583.aspx


Superior Cloud

Economics

New: SoftLayer Bare Metal POWER cloud

New: Rackspace joins OpenPOWER, declares

Open Compute OpenPOWER system

New: Docker for Power Systems

Update: OpenStack HEAT and Chef Server for Power

New: Bluemix Cloud Integration and SQLDB Services

with Power Systems for SOE/SOR integration

http://labs.runabove.com/power8/

Up to 100xthe power of a classic x86 setup

http://labs.runabove.com/power8/


Critical workloads run on Linux on Power

• Compute intensive

• High memory bandwidth

• Floating point

• High I/O rates

• High quality of service

• Scalability

• Flexible infrastructure

• Large memory footprint

Business Applications

• Highly threaded

• Throughput oriented

• Scale out capable


Web, Java Apps and Infrastructure

• Handle peak workloads

• Scalability


• Resiliency and security

HPC applications for

Life Sciences

Database

Analytics & Research


Solution stacks continuing to grow

Cloud

Software

Operating

System / KVM

Standard Operating

Environment

(System Mgmt)

Existing

Open

Source

Software

Communities

Firmware

Hardware

New OSS

Community

OpenPOWER

Technology

OpenPOWER

Firmware

• ISV community of 1,600+

• All major Linux distros

• Open sourced POWER8

firmware stack

• Resources for porting

and optimizing: OpenPOWERFoundation.org