Blueprint for the Industrial Internet of Things:Architecture

Stan Schneider, RTI CEOIIC Steering Committee

The Future is Intelligent Distributed Machines

What is the Internet of Things?

Industrial Internet of Things (IIoT)Consumer Internet of Things (CIoT)

Cyber-Physical Systems (CPS)

80% of hype

80% of value

World Economic Forum 2015

• The Industrial Internet will transform many industries, including:

– Manufacturing– Oil and gas– Agriculture– Mining– Transportation– Healthcare

• …and dwarf the consumer side

• Collectively, these account for nearly two-thirds of the world economy

The Real Challenge: Span the IIoT

…the “Industrial Internet” <will> start the next Industrial Revolution.

Joe Salvo, GE

The IIoT needs an architecture that spans industries and unites sensor to cloud.

RTI Named Most Influential IIoT Company

RTI’s Experience

• Over $1T of IIoT designs– Healthcare– Transportation– Communications– Energy– Industrial– Defense

• 15+ Standards & Consortia Efforts

– Interoperability– Multi-vendor ecosystems

180+ companies strong

Goal: build and prove a common architecture that spans sensor to cloud, interoperates between vendors, and works across industries

180+ Companies, 22 Countries

RTI’s Role in the IIC

User Experience Framework

Safety TeamArchitecture Team

Distr Data Mgmt & Interoperabilty

Use Cases Team

IIC Steering Committee IIC Staff

LegalWorking Group

MarketingWorking Group

MembershipWorking Group

Security Working Group

TechnologyWorking Group

TestbedsWorking Group

Liaisons Team

The IIC has three primary areas of activity: Community Engagement, Technology & Security, and Testbeds

Create a market

Develop an IIoT-wide architecture

Prove it & fund it

Architectural Development Process

Use Cases Architecture Standards Testbeds Products

20 Years

The IIC’s Development Process

Use Cases

Architecture

Standards

Testbeds

Products

2 Years

~10 presented IIRA initial release Next release of

IIRA

3 public~10 in

approval process

Demos in NY & Barcelona!

The IIRAIndustrial Internet Reference Architecture

The IIRA

• Comprehensive, high level– Strives for breadth rather

than depth– Establishes many key

technical guidelines– Eliminates many approaches– Outlines how things fit

together• Download it here:

http://www.iiconsortium.org/IIRA.htm– Released June 17, 2015– 102 pages

Scope

• The Industrial Internet is an internet of things, machines, computers and people, enabling intelligent industrial operations using advanced data analytics for transformational business outcomes.

• It embodies the convergence of the global industrial ecosystem, advanced computing and manufacturing, pervasive sensing and ubiquitous network connectivity.

Document Overview

• Viewpoints– Business– Usage– Functional– Implementation

• Safety• Security, Trust, Privacy

– Endpoint– Communication– Management & Monitoring– Data Distribution & Storage

• Resilience

• Integratability, Interoperability, Composability

• Connectivity• Data Management• Analytics• Intelligent and Resilient

Control• Dynamic Composition &

Automated Interoperability

Connectivity

Fundamental N2 Connectivity Problem

Approach: Limit N

• Choose a single standard for each purpose across the system– Generic Vehicle Architecture (GVA)

• Military ground vehicles

– Industrie 4.0• Manufacturing

• Pro: N=1 eases interoperability• Cons:

– Limits scope; chosen standards can’t support multiple industries

– Doesn’t address legacy integration

Approach: Generic Paradigm Translation

• Translate paradigms• Pros

– Flexible, general– Scales linearly

• Cons– Complex– Centralized; hard to

distribute

IIRA Approach: Core Connectivity Bus

• Choose “core connectivity standards”; link with “gateways”

– Fundamentally distributed– Combines other

approaches• Pros

– Can deliver performance with flexibility

– Scales linearly (only have to map each “other” to one “core”)

• Cons– Needs very functional

core standards

Can Bridge Core Standards

Endpoints

ConnectivityStandards& Protocols

CoreConnectivityStandards

Standard Gateways

Core Interoperability

Functional Domain

Key Core Connectivity Functionality

• Data Quality of Service (QoS)– Delivery Reliability and re-

delivery– Timeliness Prioritize and inform

when information is “late”– Ordering Deliver in the order

produced or received– Durability Support late joiners,

survive failures– Lifespan Expire stale information– Fault Tolerance Redundancy and

failover• Security

– Ensure confidentiality, integrity, authenticity, and non-repudiation

DDS as Core ConnectivityThe Data Distribution Service Data-Centric Standard

Why Choose DDS for Core Connectivity?

• Reliability: Severe consequences if offline for 5 minutes?

• Performance/scale: – Measure in ms or µs? – Or scale > 20+ applications or 10+ teams? – Or 10k+ data values?

• Architecture: System lifecycle >3 yrs?

2 or 3 Checks?

The DDS Data Connectivity Standard

• The Data Distribution Service (DDS) is the Proven Data Connectivity Standard for the IoT

• Very functional– Any language, OS– Extensive QoS– Security– Publish-subscribe, request-reply, REST– Peer-to-peer, reliable, multicast

• DDS: open & cross-vendor– Freely available, open standard– API and Wire spec– 13 implementations

Interoperability between source written for different vendors

Interoperability between applications running on different implementations

DDS-RTPS ProtocolReal-Time Publish-Subscribe

Distribution Fabric

DDS API

It’s All About the Data

Data centricity enables interoperation, scale, integration

Unstructured filesDatabase

Data Centricity Data at Rest

Messaging middleware

DataBus

Data Centricity Data in Motion

DDS is Different!

Point-to-Point

TCP Sockets

Publish/Subscribe

FieldbusCANbus

Queuing

AMQPActive MQ

Client/Server

MQTT RESTXMPPOPCCORBA

BrokeredDaemon

Data-Centric

DDS

Shared Data Model

DataBus

Data Centric is the Opposite of OO

Object Oriented• Encapsulate data• Expose methods

Data Centric• Encapsulate methods• Expose data

ExplicitShared

Data Model

Data Centricity Enables Interoperability

• Global Data Space– Automatic discovery– Read & write data in

any OS, language, transport

– Type Aware– Redundant

sources/sinks/nets• No Servers!• QoS control

– Timing, Reliability, Redundancy, Ordering, Filtering, Security

Shared Global Data Space

DDS DataBus

Patient Hx

Device Identity

Devices

Supe

rvis

ory

CDS

Physiologic State

Nur

sing

Sta

tion

Cloud

Offer: Write this 1000x/sec

Reliable for 10 secs

Request: Read this 10x/secIf patient = “Joe”

Contract

Data-Centric Integrated Security Model• Per-Topic Security

– Control r,w access for each function

– Enforce each dataflow

• Complete Protection– Discovery authentication– Data-centric access control– Cryptography– Tagging & logging– Non-repudiation– Secure multicast– 100% standards compliant

• No code changes!• Plugin architecture for

advanced uses

• Topic Security model:– PMU: State(w)– CBM: State(r); Alarms(w)– Control: State(r), SetPoint(w)– Operator: *(r), Setpoint(w)

CBM AnalysisPMU Control Operator

State Alarms SetPoint

Unit DataBusUnit DataBus

Sensor-to-Cloud Bus

• Connect…– Fast– Seamless– QoS controlled– Secure– Data centric

• Across 80 Platforms…• Over 12 Transports

IntelligentMachines

IntelligentSystems

IntelligentIndustrial Internet

Cloud DataBus

Site DataBus

IntelligentSystem of Systems

Unit DataBus

Sense Act

Think HMI

Machine DataBus

Think HMI

Machine DataBus

Sense Act

Think HMI

Machine DataBus

Connext DDS

Hide Sensor-Cloud

complex topology behind a

single logical

DataBus

Large Systems Need Subsystems

• Bridge– Data models– Protocols– Security

domains• Isolate

subsystems– Control export– Filter access– Translate

models

Other protocols

Routing Service

Pluggable Adapters

Transformation Engine

System

Super System

SubsystemSubsystem

SubsystemSubsystem

Edge + Fog + Cloud = “Mist”

The Edge “Fog”

Fast, Scalable, Secure, QoS control

Physical Cloud (public or private)

DDS can connect apps in the cloud, or even between clouds

Monitoring &

Collection

Data Centricity Patterns

• Publish-Subscribe

• Request-Reply

• Queuing

2004

2015

2013

Architectural Use CasesSpanning the IIoT

©2015 Real-Time Innovations, Inc.

Use Cases Drive the IIRA

The IIoT in Microcosm: Ultrasound Imagers

1991 2015

Transform Product Architectures

”BK Medical is truly redefining Medical Ultrasound Imaging The traditional single user / single system approach is being replaced with fully scalable and distributed multi-user systems

…we selected the RTI Connext DDS middleware as this gives us all the flexibility and the abstraction layer needed for the future of Analogic Ultrasound”

-- Jesper Lomborg Manigoff, VP of Engineering, Analogic Global Ultrasound

Back office

Device net, could be wireless

View anywhere

Cloud-based analytics

Core connectivity

standard

DataBus

Distributed Ultrasound

Private cloud

Public cloud

RawImageSecure

Provide a Common Platform

Revolution®

"GE Healthcare chose the DDS standard because it can handle many classes of intelligent machines.

RTI Connext DDS satisfies the demanding requirements of our devices and supports standardization on a single communications platform across product lines."

-- J Gustavo Perez, General Manager for MI&CT Engineering

Improve Safety by Connecting Devices

• Hospital error is the 6th leading cause of preventable death

• The Integrated Clinical Environment (ICE) standard specifies interoperability for medical devices

• RTI Connext DDS ties together many classes of devices from many vendors

“RTI Connext DDS met all our needs – whether we’re handling 12 patients, or 200.”

-- DocBox Founder, Tracy Rausch

Patient Monitoring

Data Bus

Supervisory Services

Patient MgmtDevice Mgmt

Systems HealthInteraction CheckingLogging

CDS Algorithm

#1

Lab Data

SPO2 CO2

PatientHx

Infusion Pump

Settings

IV Pump

Control

Infusion Pump

Measured

Values

CDS Data Architecture

Room Domain

Central Domain

Admin Domain (Cloud)

Patient Monitoring Devices

Workstations, Storage, Historian

Gateway, IX, Enterprise, 3rd Party

CDS System of Systems

Integrate System of Systems

1000s of patients, >100k devices

Control Mission-Critical Operations

• NASA KSC uses RTI for the launch control SCADA for Orion

• RTI delivered 300k points, at 400k msgs/sec with 5x the required throughput, at 1/5 the needed latency

• Launch control, in-flight monitoring, UAV tracking ground station, LPD recovery ship…all run RTI DDS

• DDS connects thousands of sensors and actuators

Large-Scale Real-Time Processing

• Sensor data captured to both Recording Services (for forensic use) and Persistence Service (for durability)

• Multicast batching from 1000s of sensors with many small samples; keeps interrupt load down

• Sensor data viewable in real-time (after time-based filtering) on the HMIs

• RS-RS bridge used for encrypted data in motion, between the event platform and control

Real-Time Monitoring Domain

DTLS Encrypted Bridge

Routing Service

Recording Services(across multiple nodes)

HMIHMI

HMI

Event Domain (unencrypted)

Recording Services

Sensor(s)

PersistenceService

Persistence Service

Event DomainEvent Domain

Event DomainEvent Domain

Handle Links from Data Center Pipes to Unreliable Wireless

• Data centers and video switches set DDS QoS for extremely fast transport

• NASA sets DDS QoS for low-bandwidth, high-delay, lossy space-earth communications

• QoS-controlled middleware communicates over any link

Connect Edge to Cloud

• Eze delivers financial trading software to more than 1,500 buy-side and sell-side institutions in 30 countries

• DDS will be the core middleware for the Eze financial trading platform• With Routing and Queing services, DDS connects scalable cloud

analytics with fast edge feedback

Analytics

Connext TCP (WAN)

ClientClient

ClientClient

Logging

Redundant, Load-BalancedReliable Multicast

Data Center Cloud

GatewayProcessor

GatewayProcessor

GatewayProcessor

GatewayProcessor

Load Balancer

(F5)

Co

nnex

t In

put

Bus

Connext Processing Bus

MonitorQueueQueueQueuing

Service

Interoperability between Subsystems

• Next-generation of – Lockheed Aegis– Raytheon DDG 1000– Raytheon SSDS– LCS (Lockheed and GDAIS)– Raytheon LPD-17– Many more, US and allies

• Highly distributed systems include radar, weapons, displays, controls

• Mix of new & legacy subsystems

• Standards-based, data-centric architecture breaks vendor lock-in, drives interoperability, and future-proofs the architectural design

Enable Massive Scalability

• Raytheon uses RTI middleware to control the new Zumwalt DDG 1000 destroyer

• RTI DDS coordinates and manages complex, diverse onboard hardware and software systems

• RTI connects hundreds of computers, thousands of applications, and more than 10m publish-subscribe pairs

• Data centric middleware extends real-time scalability

Deliver Demanding Security

• The USS SECURE cybersecurity test bed is a collaboration between:

– The National Security Agency– Department of Defense

Information Assurance Range Quantico

– Combat Systems Direction Activity Dam Neck

– NSWCDD– NSWC Carderock/Philadelphia– Office of Naval Research– Johns Hopkins University Applied

Physics Lab– Real Time Innovations, Inc.

• Objectives– Immunize against

cyberattack and to rapidly recover when impacted

– Determine the best cyberdefense technologies without impacting real time deadline scheduled performance

http://www.navy.mil/submit/display.asp?story_id=79228

Distribute Control

• Siemens Wind Power fields farms of 500 turbines with 100m blades

• DDS implements fast control within turbines and gust control across the array and reporting for predictive maintenance

Modernize Critical Infrastructure

• DDS controls the 6.8 GW GC Dam

– Largest power plant in North America

– Fastest-responding major power source on the Western Grid

– Requires 24x7 operation

• DDS meets the challenges– Extreme availability– Wide area communications– Multi-level routing– High security– 300k data values

• RTI system live since Jan 2014

Ultra Available Plant Control

RadarRadarDisplays Logging

Existing SCADA (to be replaced)

AlarmingMonitor

Interested in many quantities

IPCIPCIPC

Segment Bus

Redundant Routing

IPCIPCIPC

Segment Bus

IPCIPCIPC

Segment Bus

VPN/FirewallLocal quantity

interest

TCP (WAN)

VPN/FirewallVPN/Firewall

Control Room Bus

Control Room

Migration Server

Integrate Intelligence

• The VW Driver Assistance and Integrated Safety system helps avoid obstacles, detect lane departures, track eye activity, and safely negotiate bends

• The V-Charge program demoed an auto-charging and parking vehicle in 2014

• DDS enables advanced reactive systems in transportation

http://www.youtube.com/watch?v=7xQfKTAtyNU

Facilitate Plug-n-Play Across Vendors

• Audi hardware-in-the-loop simulation feeds realistic data to components for testing

• The system offers plug-n-play between simulation vendor solutions

• RTI middleware enables a modular test environment that scales to work with hundreds of devices

Audi-RTI HIL Testing Architecture

Scalable Tracking

Legacy design:• 12,000 tracks• 11 servers with 88 cores• Poor reliability and uptime• 1.5M SLOC• 2-8 years to develop• Custom, proprietaryDDS design:• 250,000 tracks• 80% of a single core• Full redundancy• 50k SLOC• Proof of concept in under a

week• 100% standards based

“Blue Force Tracker”

The IIC has three primary areas of activity: Community Engagement, Technology & Security, and Testbeds

Create a market

Develop an IIoT-wide architecture

Prove it & fund it

IIC Microgrid Testbed

Goals• Efficiently use solar, wind, & EVs• Create an open marketplace• Prove viability DataBusLeads• RTI: DDS middleware and system integration• NI: Engineering software and hardware• Cisco: Grid communicationsPhases1. Proof of Concept at National Instruments2. Realistic simulation at Southern Cal Edison3. Live test at CPS Energy San Antonio Grid of

the Future

Distributed Intelligence for Smart Grid

©2015 Real-Time Innovations, Inc.

The COW II will demonstrate Duke’s new microgrid architecture (OpenFMB) with solar & battery on a distributed intelligence platform.

Field Message Bus Concept

The smart machine era will be the most disruptive in the history of IT-- Gartner 2015

The Network Is the Grid

The Network is the Road

The Network is the Healthcare

The Network is the Future

• The IIoT will soon be as well defined as The Internet is today• Common technology will replace special solutions • The IIC architecture enables the IIoT to deliver on its promise to inspire

entire ecosystems

IIRA in 3.5 Minutes!

http://www.rti.com/industries/iot.html#IIRA

IoT Solutions World Contress

Get a 50% discount on the Full Pass by using the RTI Promo Code before the 15th of July: WN768DTV

D.C. Connext Conference 2015!

• Attend one or two days– Day 1. Connext DDS Developer Day– Day 2. Deep Dive: Connext DDS and the IIoT

• IIoT vision• RTI roadmap• Customer-presented application deep dives

For More Information

• RTI site: www.rti.com• Examples, forum, papers: community.rti.com• IIC website: www.iiconsortium.org• Free RTI Connext DDS Pro:

www.rti.com/downloads• Email: stan@rti.com• Connect to Stan Schneider on LinkedIn• Follow: @RTIStan