Advantages of hardware consolidation for edge computing

/ 2

OverviewAdvantages of hardware consolidation for edge computing

- Edge vs. Cloud Computing- Hardware Consolidation- Thoughts about Latency- Application Examples and Typical Requirements- Real-Time Hypervisior allows for multiple parallel OS- Hardware Implementations

- COM Express- COM-HPC

- Summary

Advantages of hardware consolidation for edge computing

Edge / Fog Computing

/ 4

Edge vs. Cloud Computing

Advantages of hardware consolidation for edge computing

/ 5

Edge vs. Cloud ComputingEdge- Less demand for uplink speed- Scalable performance CPUs- Low AI inference latency (local

processing)- Less transaction cost- Local operation with no network possible

Cloud- High speed uplink required

depending on public infrastructure- Less edge CPU speed required- AI inference latency depending on

cloud link performance- No operation without network

Advantages of hardware consolidation for edge computing

/ 6

Latency

AI analytics often demands fast local reactions- Edge:

- Fast local execution of AI algorithms- Allows for extreme fast real-time reactions

even capable for industrial motion control- Cloud:

- Transmit (huge) data to cloud (can be slow)- Execute AI algorithms in the cloud (fast)- Transmit processed data/results

to the edge (speed depends on data volume)- Each step adds latency

No real-time processingAdvantages of hardware consolidation for edge computing

Autonomous Driving Example

Hardware Consolidation

Advantages of hardware consolidation for edge computing

/ 8

All in One SystemMultiple OS/Applications

What is Hardware Consolidation?Traditional Consolidated

System 1PLC for Motion Control

System 2Edge OS / Gateway

System 3Vision/AI System

Network Switch

Uplink

Uplink

Advantages of hardware consolidation for edge computing

/ 9

Why Hardware Consolidation

Advantages of hardware consolidation for edge computing

Cost Maintenance Reliability Security Scalable

just one multicore system causes less investment and main-tenancecost

single system instead ofmultiple specialized boxes

less cables, less complex hardware systems

integrated firewall cannot be passed

all kinds of applications / OS on one system

/ 10

Hardware Consolidation Example

Advantages of hardware consolidation for edge computing

/ 11

Typical RequirementsNew technologies to be added to existing applications

Many known applications will take advantage of new technologies which are available today.

Vision- Connect cameras for application, security and safety reasons- It’s easier to add a dedicated OS with the vision application and connect it to the main

application by (virtual) Ethernet

AI- Many application software packages are available of the shelf (i.e. OpenVino from

Intel). This can be connected to the application data or to the vision application.- Easy to keep it separated on own Hypervisor instance.

IoT- Connectivity always requires high data security. This can be done easily by a dedicated

small and hardened OS. This hypervised “gate keeper” is the owner of the physical Ethernet. All other instances are connected internally.

- All kinds of connectivity methods can be applied.

Advantages of hardware consolidation for edge computing

/ 12

Boots up multiple Operating Systems- Max. 1 OS per CPU Core

Supports all current x86 CPUsAdds 0µs LatencyInternal Communication- Virtual Network- Shared Memory- Event Systems

Partitions Resources- Resources like DRAM, devices and interfaces are dedicated to

single OSes- The other OS can not access or even see the resources from the

other OSes

Real-Time Hypervisor

Advantages of hardware consolidation for edge computing

/ 13

Smart Grid ExamplePerMind Edge Server for Smart Energy Management – based on COM Express Type 7

Advantages of hardware consolidation for edge computing

How to implement an Edge Server

Advantages of hardware consolidation for edge computing

COM Express Type 7

Advantages of hardware consolidation for edge computing

/ 17

COM Express Type 7Introduces with Rev 3.0 (2017)

congatec was PICMG editor

Advantages of hardware consolidation for edge computing

/ 18

COM Express Type 7

Advantages of hardware consolidation for edge computing

COM Express Type 6 COM Express Type 7

Gigabit EthernetUSB 3.0 0-3

Gigabit EthernetUSB 3.0 0-3

LPC LPC / eSPI

SATA 0-3 PCIe 6-7SATA 0-1

10GBaseKR 0-3

USB 2.0 0-3

HDA

DDI 0-2

PCIe 0-15

USB 2.0 0-7

ExpressCard

PCIe 0-5

PEG PCIe 16-31

GPIO / SDIO

LVDS / eDP GPIO / SDIO

SER 0-1 / CAN SER 0-1 / CAN

SPI & I2C SPI & I2C

Power Power Power Power

/ 19

COM Express Type 7: The Server-On-Modules

Advantages of hardware consolidation for edge computing

conga-B7E3 conga-B7XD conga-B7ACAMD® Eypc Embedded 3000 processorsUp to 100W TDPUp to 16 cores/32 threads

Intel® Xeon® D-1500 processor familyUp to 16 cores and 24MB cacheTDP 19W to 65W

Intel® Atom® C-3000 processor familyUp to 16 cores and 16 MB cacheExtreme low power requirements down to 11.5W TDP

/ 20

COM Express Type 7: Eco System

Advantages of hardware consolidation for edge computing

conga-X7EVAL Cooling Heatpipe AdapterReference Carrier Board Enhance cooling solutions for high

performance processorsBest performance & reliability

Allows for 1 RU coolingFor CPUs 65W and beyond

/ 21

Edge Server Carrier Board Example5x5“ Micro Server Carrier Board: conga-STX7/carrier – from IESY

Advantages of hardware consolidation for edge computing

COM-HPC

Highest Performance COMs

Advantages of hardware consolidation for edge computing

Advantages of hardware consolidation for edge computing

highest performance module standard

no replacement for COM Express, a new class on top

congatec is creator of open standards

/ 24

COM-HPC.Supporting Companies

Sponsors:- Adlink, Kontron, congatec

Official Positions:- Chairman: Christian Eder, congatec- Editor: Stefan Milnor, Kontron- Secretary: Dylan Lang, Samtec

20 Members:- Adlink, Advantech, congatec, Elma Electronic, Emerson Machine Automation

Solutions, Ept, Fastwel, GE Automation, HEITEC, Intel, Kontron, MEN, MSC Technologies, N.A.T., Samtec, Seco, TE Connectivity, Trenz Electronic, University Bielefeld, VersaLogic Corp.

Schedules- PICMG workgroup officially started Oct 23, 2018- Pinout pre release Q3/2019- Specification final Q1/2020- Design guide final Q1/2020

COM-HPC

Chairman Christian Eder

/ 25

COM-HPC.Next generation Computer-On-Module Specification

Why a new standard?- The COM Express connector is limited- Max. 32 lanes PCIe Gen 3.0 (8 Gb/s)- Max. 10 Gb Ethernet per signal pair- Was released in 2005

COM-HPC target- Support for PCIe Gen 5.0 (32 Gb/s)- 64 PCIe Lanes- Min. 25 Gb Ethernet per signal pair to support 100 Gb Ethernet- Update of other interfaces- Will be released in 2019

Advantages of hardware consolidation for edge computing

/ 26

Edge Rate® Contact Design

Self-align BGA Design

Product Video

Ease of Processing

Advantages of hardware consolidation for edge computing

/ 28

Size: COM-HPC/ServerDraft May 2019

COM-HPC

/ 29

Size: COM-HPC/ClientDraft May 2019

COM-HPC

/ 32

Summary.

Cloud vs. Edge- We don‘t have the network capabilities to process everything in the cloud- Edge servers takes the task for local (pre-) processing

Innovation- Is mostly a combination of available technolgies i.d. AI / Vision / IoT with traditional

use cases- This can be performed the easiest when new technologies are hypervised

Hardware Implementation- Rugged servers for edge applications can be realized by COM Express Type 7 today.- There‘s a new standard in preparation which will allow for x10 l/O performance:

COM HPC

congatec simplifies the use of embedded technology.

Advantages of hardware consolidation for edge computing