xilinx technology day · 2019-10-19 · 赛灵思技术日 xilinx technology day 赛灵思技术日...
TRANSCRIPT
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY
翁羽翔Xilinx 工业与医疗市场营销经理2019 年 3 月19 日
工业物联网 —端(Edge)云(Cloud)共舞,加速工业 4.0
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY
如何定义 IIoT?
端的主要组件是什么?
IIoT 时代如何连起端和云?
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
IIoT = 端和云的协作
AssetCloud Control NetworkController I/OEnterprise
NetworkInternet
“OT”“IT”
Fog Node
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
IIoT 内部的端
Think
Do
SeeEdge Senses(Sees) Edge Passes Data to Cloud for Learning
Edge Performs Inference and Creates Plan
能够在没有云的情况下自主采取行动
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
IIoT 连接 = TSN + OPC UA
OPC
UA
othe
r Ind
ustri
al
Prot
ocol
s
OM
G D
DS
IEEE
172
2
Prof
inet
IEC
618
50
Ethe
rNet
/IP
IEEE 802.1 TSNand related Foundational Services
(Time Synchronization, QoS, Redundancy, Security, Network Configuration, etc.)
Data Link/Network/Transport
Applications,Services,
...
Ethernet (IEEE 802.3) Physical
OPC
UA
othe
r Ind
ustri
al
Prot
ocol
s
OM
G D
DS
IEEE
172
2
Prof
inet
IEC
618
50
Ethe
rNet
/IP
IEEE 802.1 TSNand related Foundational Services
(Time Synchronization, QoS, Redundancy, Security, Network Configuration, etc.)
Data Link/Network/Transport
Applications,Services,
...
Ethernet (IEEE 802.3) Physical
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
IIoT 中的感测传感器
Clearer, Faster and Smarter Way to See the WorldBeyond Human Eye
Visible image Sobel Edges Image Fusion
RESIZE
SOBEL
WARP
COMBINE
Warped ResizedZynq/MPSoC
GigE v2.0 -> GigE v2.1 --> 2/5GigE -> 10/25GigE
CXP v1.1 -> CXP v2.0 (Add CXP-10 & CXP-12) -> CXP v2.1
USB3.0 -> USB3.1 -> USB3.2
Camera Link -> Camera Link HS(CLHS)
SLVS-EC 1.2, MIPI 2.1 for 4K @ 120fps CameraXilinx 45nm, 28nm 28nm, 20nm, 16nm
Smarter
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
Frameworks& Libraries
Development tools
Platforms HDMI
MIPI
USB3
Machine Learning
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
面向 Edge / Embedded ML 的 DeePhi Solution Stack
Core API
Driver
RuntimeLoader
Profiler
Models
Framework
Tools & IP
HW Platforms
CompressionPruning Quantization
CompilationCompiler Assembler
Face detection Pose estimation Video analytics Lane detection Object detection Segmentation
Z7020 Board Z7020 SOM ZU2 SOM ZU2/3 Card ZU9 Card ZCU102 ZCU104 Ultra96
Darknet
Deephi also has LSTM IP for KU115/VU9P as a part of Cloud ML
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
Xilinx TSN – IIoT 互连
Premium or High-End
Compact or Low-End
Standard or Mid-Range
Analytics & Cloud
Safety & Security
Precision ControlSensor Fusion
Any-to-Any Connectivity
Image Processing Machine Learning Inferencing
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
Xilinx TSN – 评估系统
Traffic GeneratorTraffic Receiver
Terminal (UART) +Debug (via Ethernet)
Both ZC702 and ZCU102 Support TSN Evaluation
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
Xilinx IIoT Stack – 安全混合关键平台
Virtualization Layer
OS Layer
IIoT “Apps”
IIoT
GW
&
Mgm
tCloud
Services
Real-time CtrlRTOS
Container LayerLinux
HW Layer HW OffloadingHW Offloading
TSNVersalZynq7K ZynqUS+
Scalable HW Platforms
Jailhouse
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
Xilinx IIoT Stack – 安全混合关键平台
˃ HW & SW component focusedFlexibility → IIoT diversityCustomer integration of legacy + IIoT
˃ Mixed criticality infrastructureMulti-core platform targetSegmented configurability Hypervisor cache coloringTime Sensitive Networking (TSN)
˃ Best in class platform securityUnique device identity → IoT device provisionSecure boot of SW componentsCrypto accelerators → Authen & encrypt HW Security Device
Secure Boot
Validated OS
Trusted Apps
Secure Comms
System Monitoring
Trus
t Cha
in
Xilinx enablers & accelerators
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
AWS + Xilinx – Edge 和 Cloud PoC 的加速
Linux Docker
AWS
IoT
Devi
ce M
gr
AWS
IoT
Devi
ce
Defe
nder
AWS Greengrass
AWS
IoT
One-
Clic
k /
Head
less
Enr
ollm
ent
Cust
omer
La
mbd
a Ap
ps
AWS Greengrass Device Mgr
Control Plane/Configuration
AWS Device Defender Auditor
Device Integrity Status
AWS Alerts ServiceAsynchronous Alerts
AWS IoT ServicesHTTPS, WebSockets, MQTT
IoT Analytics DynamoDB
S3
Lambda SageMaker
Kinesis
Cust
omer
Nat
ive
Linu
x App
s
Processing Sytem
CPU0 CPU1Programmable Logic
CPU2 CPU3
Virtualization (optional)
Math Accelerators
Industrial Coms
ProfinetIP Network
OPC-UA Communication
Video Safety/Surveil lance
TSN Enabled Networks
HW Accel
HW Accel Intf
HW Accel
VCU DSP
TSN SecAccel
IoT CoreLambda
˃ AWS initial PoC partnership
˃ Pursue other IoT cloud partners following learnings w/ AWS
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
AWS + Xilinx – Xilinx 基于 Greengrass 的差异化方案
Zynq US+ APU
Greengrass SDK
Lambda FunctionLambda FunctionLambda Function
Greengrass App Layer
Linux
Greengrass BasicGreengrass running on Linux.Demonstrate:• Lambda function at Edge on ZU+• Secure comms to AWS cloud• Collaboration with FreeRTOS node
Greengrass Xilinx AcceleratedHW accelerated Greengrass w/ PYNQ.Demonstrate:• Lambda function acceleration in FPGA• Device shadow configuration/update• Machine learning inference
Zynq US+ APU
xdevcfg devmem sysgpio xlink
libsds
uio
PL MIMO GPIO XLNK Interrupt
Overlay
pynqmicroblaze
axi_gpio
audio
video
logictools
dma
Driver Layer
API Layer
Greengrass SDK
Lambda FunctionLambda FunctionLambda Function
Greengrass App Layer
Zynq US+ PLaxi_intc
base
over
lay
Cust
om H
W
Acce
l
ML
Infe
renc
e
Real
-Tim
e Co
ntro
l
Greengrass Xilinx Extensions
Linux
https://aws.amazon.com/iot-core/getting-started/
AWS IoT HW Partners
Greengrass Acceleration w/ PYNQ Infrastructure
Greengrass Acceleration w/ PYNQ Infrastructure
赛 灵 思 技 术 日XILINX TECHNOLOGY DAY © Copyright 2019 Xilinx
重点总结
IIoT brings great opportunities and challenges for XilinxIIoT 为赛灵思带来了巨大的机遇和挑战
Xilinx offers multi–dimensional and multi-level solutions to embrace IIoTXilinx提供了多维度和多级别的解决方案以支持 IIoT
Tool/IP/Demo/Ref design is available now for evaluation & development工具/ IP /演示/参考设计一应具备 — 现已可立即着手评估和开发
1
2
3