characerizing and validating qos in the emerging iot network

Slide Header…

QualiSystems Proprietary & Confidential

Wednesday, May 3, 2023Wednesday, May 3, 2023

Characterizing and Validating QoS in the Emerging IoT NetworkHans Ashlock, Technical Marketing

Slide Header…


Global Software Company• Established 2004, privately held• North America HQ: Santa Clara, CA• R&D Center: Tel Aviv, IsraelMarket-leading supplier of automation solutions for:• DevOps cloud and network orchestration• Physical and virtual lab management• Test and continuous integration automation

Mature, proven technology:• Hundreds of customer deployments• Millions of infrastructure elements managed• $Billions in infrastructure managed

Quali Company Overview

Slide Header…


IoT: Contending with an Elephant

* Taken from IEEE-P2413 Intro

Slide Header…


Network Metrics- Latency- Jitter- Throughput- Reliability

End-to-End Application Quality- Environment- Energy- Speed- Quality- Resolution

Quality of Service

Slide Header…


State of IoT Validation/Test TodayArchitect

ure / Framewor

k

Certification Program

Compliance Testing

Interop Testing

Third Party Validation

LabsFormal

Testbeds

AllSeen AllianceAllJoyn

AllJoyn Self-Guided Certification

Mid 2015 Mid 2015 Mid 2015

Thread Group Thread / 6LoWPAN

Mid 2015 Mid 2015 Mid 2015 Mid 2015UL & Granite

River

OICIoTivity

IoTivity Mid 2015

IIC Reference Architectur

e

Smart Tooling,

MicrogridsIPSO Interop

showcases

IEEE IEEE P2413 In

development

Slide Header…


What is the state of IoT service validation today?

Incubation

R&D Labs

Standards Architectural Specs

Certification

Programs

Formalized Test and Interop

Vendor and

Provider Solution

Ecosystems

Industry Maturity

Traditional

Emerging

(SDNNFV)

IoT

Slide Header…


IoT Use Case ComplexityIsolated

Non-CriticalIsolatedCritical

UbiquitousNon-Critical

UbiquitousCritical

Vehicle Control System

Smart Thermostat

Quetym™

Traffic Monitoring

Smart Home

Smart Retail Pervasive Health Care

Structural Monitoring

Self Driving Car

Where We’re Headed…

Slide Header…


Explosion of Device Count and Data• 50 billion in 2020

Network Heterogeneity• Technologies, protocols, devices, architectures, local, global

Dynamic Service Composition• Creating services on the fly• Unpredictable nature of underlying network

Compound Service Composition• Repurposing things for different services• Multiple applications co-existing

Nodes function as end-points and routers• QoS must account for demand of intermediary nodes

Emerging IoT Network Challenges

VLANS?

Slide Header…


IoT Technologies and Protocols

Slide Header…


Autonomous • IoT network isolated as “smart network”• Single gateway “smart connector”

Ubiquitous• IoT devices integrated into internet• Multi-hop, multi-access (radio), shifting topology

Application Overlay• NFV enables overlay network• In-network data processing reduces congestion

Service Oriented Network• Network functions as services• Networks composed on the fly (literally)

IoT Network Architecture Diversity

Slide Header…


Traditional Validation Approaches

Requirements• Resource Pool

• Modularity

• Reusability

• Scalable

Script Based• No inherent notion of the

infrastructure resource pool• Often multi-step list of

commands• Often poorly documented

and unusable beyond original developer

• Often hard coded; not architected to scale

Slide Header…

QualiSystems Proprietary & Confidentialhttp://www.despair.com/quality.html

Slide Header…


Inventory objects:• Actual inventory including physical, virtual, NFV, apps, tools, subnets, etc.• Abstracted meta-model• Enables reservation/multi-tenancy

Provisioning objects• Resource level interfaces

Process task objects• Test automation (functional, sanity, regression)• Continuous Integration

Build and Maintain an Object Layer Best Practice

# 1

Slide Header…


Pre-packaged libraries (of course)Independent interface creation:

• Integrate and “objectize” API’s• Utilize existing scripts (TCL, python, etc.)— no “starting from zero”• Capture and objectize CLI, SNMP, terminal interactions

Make them small and maintainableOvercomes interfacing obstaclesRemoves roadmap dependenciesHelps integrate legacy/special infrastructure

OOTB & DIY Integration Approach Best Practice

# 2

Slide Header…


Visual environment/topology modelling• Inventory-based modeling• Enables reservation of entire environments• Model any arbitrary network topology• Abstract design to maximize utilization• Dramatically scale service creation

Visual workflow authoring• Hide syntax from users• Abstract service test flows• Continuous integration, test automation

Self-Service, Transparent End User Access• End user modelling of IoT validation environment• Repeatability• Multi-tenant

De-Couple Modeling from Automation Best Practice

# 3

Slide Header…


Cisco DevNet Example

Slide Header…


Cisco DevNet Topology Modeling, Provisioning, Reservation, and Reuse

Slide Header…


http://standards.ieee.org/innovate/iot/study.html

http://www.grifs-project.eu/data/File/CERP-IoT%20SRA_IoT_v11.pdf

http://www.iiconsortium.org/test-beds.htm

http://netlab.cs.ucla.edu/medhoc2011/papers/p171-hellbruck.pdf

http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6582811

https://hal.archives-ouvertes.fr/inria-00630092/document

http://mpc.ece.utexas.edu/Papers/SESENA2011.pdf

http://ieeexplore.ieee.org/stamp/stamApp.jsp?tp=&arnumber=6381043

Further Reading




http://www.grifs-project.eu/data/File/CERP-IoT%20SRA_IoT_v11.pdf

http://www.iiconsortium.org/test-beds.htm

http://netlab.cs.ucla.edu/medhoc2011/papers/p171-hellbruck.pdf


https://hal.archives-ouvertes.fr/inria-00630092/document

http://mpc.ece.utexas.edu/Papers/SESENA2011.pdf


Slide Header…


Visit our WebsiteVisit our Website

characerizing and validating qos in the emerging iot network

Technology