september 2021 doc.: ieee 802.15-21 -0484-00-06a project

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)Slide 1

Project: IEEE P802.15 Working Group for Wireless Personal Area Networks (WPANs)

Submission Title: [SG15.6a Application Matrix and Use cases for dependable social services based on BAN/5G/AI platform]Date Submitted: [15ｔｈ September 2021]Source: [Ryuji Kohno] [1;Yokohama National University(YNU), 2;YRP International Alliance Institute(YRP-IAI)] Address [1; 79-5 Tokiwadai, Hodogaya-ku, Yokohama, 240-8501 Japan

2; YRP1 Blg., 3-4 HikarinoOka, Yokosuka-City, Kanagawa, 239-0847 Japan]Voice:[1; +81-90-5408-0611], FAX: [+81-45-383-5528], Email:[1: [email protected], 2: [email protected]] Re: []Re: []

Abstract: [This document contains application matrix and focused use case for dependable social services based on BAN-base cloud network and AI data server for SG15,6a]

Purpose: [information]Notice: This document has been prepared to assist the IEEE P802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.Release: The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by P802.15.

September 2021

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)Slide 2

IEEE 802.15 SG15.6a Application Matrix and Use cases for dependable social services based on

BAN/5G/AI platform

Virtual Interim MeetingSeptember 15th, 2021

Ryuji KohnoYokohama National University(YNU),

YRP International Alliance Institute(YRP-IAI)

September 2021

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)

Proposed applications1. Remote healthcare monitoring2. Remote sensing and controlling3. Vehicle internal sensing and controlling4. Collision avoidance radar5. Inter-vehicle communications and ranging6. Wearable and implant wireless medical sensing and controlling7. Applications for ultra wideband radio8. Reliable and robust radio control9. Wearable healthcare sensing10. Secure remote healthcare and medicine11. Wireless sensing system for Factory with feedback control12. Dependable multi-hop inter-vehicle communications13. Inter-navigation and inter-vehicle information sharing in normal

and emergency conditions14. Single wireless communication network solution that functions

both in normal and in disaster environments15. Disaster prevention, emergency rescue and recovery

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Fitness, Massage& Sauna

Sports: Walking, Jogging,Bicycling, Hiking, Skiing etc

Public Safety

Inter-Vehicle M2M

Highly Life Critical Uses(High QoS)

Less Life Critical Uses(Low QoS)

Home & Consumer Uses

Industrial & Governmental Uses

Internal Car Dependable M2M

Inter-Vehicle M2M

Home Medical Therapy

Government Infrastructure

Visualizing Portfolio of Focused Applications

Remote Diagnosis for Factory Automation

Hospital Clinical Service

Remote Wellness& Well-being

Life Line(Water/Gas/Electricity Supply)

4

Remote Sensing & Controlling Mobile Robots

Disaster Analysis & Prevention

Remote Diagnoses of Infra(bridge/bldg./train)

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Three Classes of Focused Potential Applications

Slide 5

QoS 1 Class: Highest Priority Level for Demand of Dependability 1.1 Car Internal M2M1.3 Remote Diagnosis in Factory2.3 Professional Medicine3.2 Public Safety

QoS 2 Class: Meddle Priority Level for Demand of Dependability1,2 Inter-vehicle M2M2.2 Healthcare3.1 Life Line (Water/Gas/Electricity Supply)4.1 Remote Diagnosis of Infra(bridge/bldg./train)

QoS 3 Class: Low Priority Level for Demand of Dependability2.1 Wellness, Wellbeing3.3 Government System4.2 Remote Sensing and Controlling Mobile Robots 4.3 Disaster Analysis and Prevention

We have classified focused potential applications into three classes according to demands of dependability.

September 2021

doc.: IEEE 802.15-21-0484-00-06a


(Case 6) Would a good wireless solution benefit your application?

If yes, please describe the benefits you would like to realizeWireless sensing and controlling system for Factory

1. Equipment Diagnosis System in Real-time with real-time feedback

1. Real-time measuring 2. Judge immediately with a certain threshold level3. Feedback controlling

2. Equipment Diagnosis System in Real-time (1)1. Real-time measuring and sending data in real-time2. Judge based on the comparison with the past data3. Analysis of big data4. Feedback controlling machines in remote

3. Equipment Diagnosis System in Real-time (2)1. Real-time measuring and sending data intermittently2. Judge based on the comparison with the past data3. Database and data mining with cloud networking

Slide 6

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Possible Use Cases of Dependable M2M and BAN for Sensing and Controlling

Micor Machine Fablication

On Chip Antenna andWireless Network in chio

MMIC(Flip Chip)

Multi-layer BCBSilicon Base

Silicon BseeTele-metering vital dataWearable BAN Implant BAN

Tele-controlling implant devicesEEG.

ECG,Blad PressureTemperatuteMRI imagesEtc. Pacemaker

with IAD

Dependable Network among vitalsensors, actuators, robots Capsule

Endoscope

UWB can solvesuch a problemthat radio interferes

a human body and medical equipments

B車

Collision Avoidance and safe driving by inter-vehicle networks

A車

Collision Avoidance Using inter-vehicle and roadside networks

Road to car networks Inter-vehicle networks

Inter-module wireless Networks

Dependable Wireless Sensing & Controlling for Manufacturing (CIM)

Dependable Wireless System Clock in Micro Circuit & Network in DevicesDependable BAN for Medical Healthcare

Dependable Wireless Networks for TransportationFactory Automation (FA)Car Navigation & Collision Avoidance Radar

Car LAN & Wireless Harness

Slide 7

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Wireless Feedback Sensing and Controlling Loop for Diabetes Patients

With

controllerWirelesschannel

PumpClinician Patient

sensor

InsulinPump

Blood-sugar level(Glucose) HbA1c

KWirelesschannel

Bd 1/S

Ad

u[k]r[k]

u[k]

x[k] x[k]

y[k]

^

^

++

+-

Controller Human Model of Glucose vs Insulin

Automatic Remote Sensing Glucose and Controlling Insulin Pump for Diabetes Patients Using Wireless BAN

Wireless Feedback Controlling based on Cognitive Sensing with Dependable BAN must be necessary for life critical applications.

Feedback Delay Loop Model with Motion Equation

September 2021

Slide 8

doc.: IEEE 802.15-21-0484-00-06a


Dependable IoT/M2M for Advanced Driver Assistance Systems(1/2)••••••

4-6 Mono Cameras1-2 Stereo Cameras2-4 Mid-Range Radar2 Long Range Radar8-16 Ultrasonic Sensors, 4 Wheel Speed SensorsRedundant Data Center

– Number Crunchers for Data Fusion– ABS, ESP, …– Some ECUs we can’t tell you details today

• Interaction with Powertrain, Body Domain, Navigation,Airbag, CAR2CAR, CAR2Infrastructure

Does this look familiar to data centers?

Automated Driving is leaving the Research Labs. Soon it will be in mass production.

Surround vision with redundant sensors

For automotive, Inter-vehicle communications(IVC) and Machine-to-Machine(M2M) inside a car like auto braking and autonomous driving must be core applications of Dependable M2M and IoT.

September 2021

Slide 9

doc.: IEEE 802.15-21-0484-00-06a


Demands for Internet of Things increase but Machine-to-Machine (M2M) should be reliable and secure, so Dependable BAN for Medicine must be good matched with Dependable M2M and IoT.

Dependable IoT/M2M for Advanced Driver Assistance Systems(2/2)September 2021

Slide 10

doc.: IEEE 802.15-21-0484-00-06a


Wireless Feedback Sensing and Controlling Loop for Autonomous Driving

With

controllerWirelesschannel

Axel/BrakeDriver Own Car

Radar

For Autonomous Driving

For Collision Avoidance and Inter-Vehicle Communication

KWirelesschannel

Bd 1/S

Ad

u[k]r[k]

u[k]

x[k] x[k]

y[k]

^

^

++

+-

Controller Car Axel/Brake Model and Radar System

Collision Avoidance Radar and Automatic Braking Using Wireless Dependable M2M/BAN

Feedback Delay Loop Model with Motion Equation

Car Running Ahead

September 2021

Slide 11

doc.: IEEE 802.15-21-0484-00-06a


Response to CFI: Case 6Hiroshi Kobayashi, Nissan Automotive Co. Ltd.

Update in Development ofWireless Sensing System

for FactoryDoc.:IEEE802-15-15-0221-01-0dep

IEEE802-15-15-0711-00-0depIEEE802-15-15-0711-01-0depIEEE802-15-16-0077-00-0dep

Slide 12

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Use case 2; Detection of Twist and Cut of Cables

Prediction and Real-timeDetection of twist and cut in signal and power cables

Slide 13

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Use case 3; Real-time Monitoring or/and Controlling Robots

In order to improve QoS of controlling robots in factory lines, real-time sensing and controlling with permissible feedback control loop must be important requirement

Slide 14

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Use case 1; Detection of Cracks in Press Machine

Prediction of cracks and any damages in press machines is keen to keep stable operation of lines in factory automation.

Slide 15

September 2021

doc.: IEEE 802.15-21-0484-00-06a


Remote Medicine; Medical ICT & AI with BAN

16

BAN

切替

WINDS

Satellite Networks

Medical ICT Center Etisalat Wireless & Data Clued Services

Yokohama City Univ.Hospital and Remote Clinical Center

BANMobile Station

Medical support for over the world

BANVSAT

BAN

Satellite Link

Big Data

InternetCellular Network Data mining

5G/IoT Network Cloud

September 2021

Slide 16

doc.: IEEE 802.15-21-0484-00-06a


Coordinator

Node

Node

Elderly peopleTherapist, Nurses,Care givers

Big Data Server &

Repository

Hospital,Rehabilitation

Center orClinicians

Gateway

Network cloud

Body Area Network(BAN)

Data mining or Analysis with Deep Learning

like Watson

Node

physical assistant and surgery robots

Platform by Wireless BAN, Network Cloud, Big Data Server with Data Mining for Elderly People Care

September 2021

Slide 17

doc.: IEEE 802.15-21-0484-00-06a


Universal Platform with Integrated ICT, Robotics and AI by Remote Sensing and Mining of Vital Data for High Quality of Life with Medicine, Wellness, and Sport

Hospital,Day Care CenterGateway

Coordinator

5G/6G, Internet for Cloud

Network, Edge Computing

Efficient and Professional Diagnosis and Therapy

ProfessionalClinician

METI, FCC; Supervise of Medical Big Data Processing and ApplicationPMDA, FDA; Clinical Study and Validation of Medicine and Medical Devices

Rehabilitation RobotsWheelchair

AI Data mining of Medical Big Data with

Deep LearningEx. Watson

Walking Assist Robots (HAL, ReWalk)

Node

Node

Vital Data

Command

Node

Node Node

OfficialNetwork

University Hospitals

Telecom Carrier Operator

Rehabilitation Center

Official Network

Clinician, Nurse, Therapist

Node

International Standard of Medical Body Area Network (BAN) IEEE802.15.6

Medical Database, Repository

Body Area Network (BAN)

Diabetes & Metabolic High Society People

Remote Sensing Glucose level &

controlling wearable insulin pump by BAN

Prof. Ryuji Kohno’s Properties, Confidential

Sensing Physical and

Mental Condition

Sensing Mental & Physical Condition for Training

Elderly Patient, Sport Athlete

Node Node

Detect and Prevent Pandemic of COVID-19

September 2021

Slide 18

doc.: IEEE 802.15-21-0484-00-06a


API

Network cloudGateway

API

API

CoordinatorAPI

API APIBluetooth node

APIWi-Fi node

BT/B

LE

SensorSensor

ActuatorActuator

SensorSensor

ActuatorActuator

SensorSensor

ActuatorActuator

APICoordinator

API

UWB node

API APIBluetooth

node

SensorSensor

Actuator

Actuator

SensorSensor

ActuatorActuator

Body Area Network; (BAN)

UWB node

Medical Healthcare Data Mining and Networking Based on Universal Platform by Wireless BAN, Network Cloud, Data Server with AI Data Mining

Ryuji Kohno's Properties, Confidential

Slide 19

doc.: IEEE 802.15-21-0484-00-06a


High Quality of Life by Parasports Supported by Wireless BAN, Network Cloud, Assisting Robots, AI Data Science

1. Guarantee Safe and Enjoyable Training and Games for Parasports ex. Chair Basketball & Ski2. Fair Judgement of Sport Games with Wireless Sensing

20

doc.: IEEE 802.15-21-0484-00-06a


Integrated Platform among Wireless BAN, 5G/6G Cloud Network and AI Data Servers

21

Coordinator

4G, 5G, 6GCellularWi-FiWiMAX etc.

Individual Wireless Connection for each a sensor

Cloud NetworkUSB

Coordinator Windows

Android

iOS

※Coordinator in figure is just an image.

Data Mining

Cloud Server/Data Center System Operation

Network Operator

University HospitalsRemote Clinical Treatment & Testing

Regulatory Compliance Test, R&D, Standardization of Healthcare ICT

ECG Sensor

Glucose Sensor

Rehabilitation Robot& Wheel Chair

Surgery Robot

Multiple Sensor(SPo2 EEG, etc.)

ECG Sensor

BAN for User 1

BAN for User 60

….

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)22

22

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)Ryuji Kohno's Properties, Confidential23

doc.: IEEE 802.15-21-0484-00-06a

Submission Ryuji Kohno(YNU/YRP-IAI)Ryuji Kohno's Properties, Confidential24

september 2021 doc.: ieee 802.15-21 -0484-00-06a project

Documents