sai update and roadmap...sai tamv2 use cases streaming telemetry • stream data and events directly...
TRANSCRIPT
![Page 1: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/1.jpg)
![Page 2: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/2.jpg)
SAI – Update and Roadmap
Guohan Lu, Principal Dev Manager, MicrosoftJai Kumar, Distinguished Engineer, Broadcom
[Networking]
![Page 3: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/3.jpg)
Switch Abstraction Interface
CRUD operation over extensible Entity/Attribute/Value data model
Reference data-plane behavior model supports various devices
Significant feature/partner growth since announcement in 2014
https://github.com/opencomputeproject/SAI
![Page 4: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/4.jpg)
SAI API and Objects
APIs:
• sai_create_api
• sai_set_api
• sai_get_api
• sai_remove_api
4
SAI DB
KEY SAI_OBJECT_TYPE:SAI_OBJECT_ID
SAI_OBJECT_ATTR
SAI_OBJECT_ATTR
SAI_OBJECT_ATTR
VALUE
VALUE
VALUE
SAI_OBJECT_TYPE_NEXT_HOP:00000001
SAI_NEXT_HOP_ATTR_IP
SAI_NEXT_HOP_ATTR_TY
PE
10.0.0.1
SAI_NEXT_HOP_IP
![Page 5: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/5.jpg)
SAI Function Calls & Pipelines
create_router_interface
create_neighbor
create_next_hop
get_switch_attribute
create_host_interface create_route
Port PortRIF RIFRouteNext
HopNeigh
create_router_interface
get_switch_attribute
create_host_interface
• Register SAI APIs to achieve specific functions and control logging
separately
• Construct the right order to execute SAI function calls
• Refer to SAI Pipelines to create the right packet action flow
![Page 6: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/6.jpg)
Monitoring
TAM [Broadcom]
Microburst [Marvell]
Critical Resource Monitoring [MSFT]
INT [Barefoot]
Protocol Support
MPLS [Mellanox]
802.1BR [Dell]
Segment Routing [Cavium]
Basic L2/L3 Forwarding
Reliability/QoS
L3 Fast Reroute [Metaswitch]
BFD [Dell]
ECN [Dell]
What is in SAI
Infrastructure
SAI P4 Model [Mellanox]
Multi-NPU [Dell]
Capability Query [MSFT]
SAI Ext API [Dell]
![Page 7: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/7.jpg)
![Page 8: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/8.jpg)
Broadcom Proprietary and Confidential. © 2016 Broadcom. All Rights Reserved. "Broadcom" refers to Broadcom Limited and/or its subsidiaries.
SAI Telemetry And Monitoring v2.0(SAI TAMv2)
![Page 9: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/9.jpg)
Agenda
• Contributors
• Uses cases
• High Level Architecture
• Next Steps
![Page 10: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/10.jpg)
Contributors
• Author – Jai Kumar, Broadcom Inc.
• Co-Author – Imran Pasha, Cisco Systems Inc.
• Credits
- Hui Ma, Microsoft Inc.
- Tushar Tyagi, Broadcom Inc.
- Nikos Triantafillis, LinkedIn Inc (now at Apstra).
- Vitaly Vovnoboy, Marvell Inc.
- Gidi Navon, Marvell, Inc
- Ashok Daparthi, Dell Inc.
- Mike Lazar, Dell Inc.
- Mickey Spiegel, Barefoot Inc.
![Page 11: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/11.jpg)
SAI TAMv2 Use cases➢ Streaming Telemetry
• Stream data and events directly from
silicon➢ Ability to define Advanced Mathematical
Functions (AMF) on data
• Hierarchical Analytics
• Stream Raw Data or Summary
Reports
• Promote HW implementations of
AMF
• Walk towards ML➢ Single Consistent Data Model for Internal and
External Consumption
• Internal – SONiC
• External - Collector➢ Flexible data encoding
• Proto, Thrift, JSON, custom➢ Flexible transport
• UDP, TCP, localhost, gRPC
WireNative Native
Data Plane Producer
Streaming Tunnel
Control Plane Producer
External Collector
Wire FormatNative Format Native Format
serialization De-serialization
Local Collector
(SONiC)
Data, Events, Op State
![Page 12: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/12.jpg)
SAI TAMv2 Architecture
TAM 2.0 API
Data Plane
Subscribe for Data Object(s)
Define Frequency of data
Define wire format of data
External Collector
NOS[Local Collector]
Define destination of data[External or local]
▪ Generic TAM Objectso Telemetry Streaming object is a collection of data, transport, report and
collector
o All telemetry data is characterized in single consistent way
▪ Generic Reportingo Data serialization used to parametrize a report
o Reporting object consists of serialization protocol
o Serialization/Deserialization is done using protocol compiler
o Seamlessly consumed by collector
▪ Generic Event Frameworko All events are a collection of event type and action
o Event action can be report or a feedback loop
▪ Mixed vendor deploymento No chip specific API
o Extensible Telemetry object, report types, and events
▪ Advanced analyticso Thresholding, triggered streaming (threshold breach)
o Running average/mean/mode
o Historgrams
GET DATA
![Page 13: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/13.jpg)
SAI TAMv2 Architecture….contd
![Page 14: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/14.jpg)
SAI TAMv2 Next Steps
Pull Request 874 – Reviewed and Closed, Target Release SAI 1.4
https://github.com/opencomputeproject/SAI/pull/874
Pull Request JaiOCP/2 – IFA/IOAM/P4INT API, Open for Reviewhttps://github.com/JaiOCP/SAI/pull/2
![Page 15: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/15.jpg)
PTP (Precision Time Protocol)
• Use cases
• Time synchronization among the switches and servers
• Debug packet latency issues in the network
• ASIC functions
• Timestamping Tx/Rx packets
• Adjust hardware clock time, e.g., offset, frequency
• SAI Interface
• Host traps (trap PTP packets)
![Page 16: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/16.jpg)
PTP Linux Stack
Linux PTP Stack
Netdev driver Clock driver
ASIC Hw Clock
Set TimeGet TimeRecv PktSend Pkt
Recv Tx TS
User Space
Hardware
Kernel Space
SAI
Enable PTP
timestamping
![Page 17: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/17.jpg)
PTF Tests
• Validate SAI Implementation
• Call SAI API
• Send packet to validate ASIC forward the packet correctly
Switch Host
L2 Entry
![Page 18: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/18.jpg)
Test case updates
• Add 18 cases, L2, L3, ECMP, Neighbor, ACL
• Total 82 test cases
Area Number
L2 15
L3 32
Host Interface 11
ACL 8
Mirror 5
Tunnel 11
![Page 19: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/19.jpg)
Call for participation
• New spec contribution in new area
• IFA, NAT, external phy, mac sec
• New PTF test contribution
• Improve PTF test coverage
![Page 20: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/20.jpg)
Open InvitationInviting contributions in all areas
• SAI
• New features spec, test code
Website: https://github.com/opencomputeproject/SAI
Mailing list: https://ocp-all.groups.io/g/OCP-SAI
![Page 21: SAI Update and Roadmap...SAI TAMv2 Use cases Streaming Telemetry • Stream data and events directly from silicon Ability to define Advanced Mathematical Functions (AMF) on data •](https://reader033.vdocuments.net/reader033/viewer/2022041823/5e5fa04a37a72453fe484d54/html5/thumbnails/21.jpg)