november2019 docdoc..: : ,((( ghs …...closed loop dbs brain machine interfaces (bmi) stimulation...

23
November 2019 Project : IEEE P802.15 Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [WNG Higher speed wireless body area networks are required for implantable brain- machine interfaces] Date Submitted: [18 July 2019] Source: [Masayuki Hirata1, Takafumi Suzuki2] [1; Dept. of Neurological Diagnosis and Restoration, Graduate School of Medicine, Osaka University, 2; Center for Information and Neural Networks(CiNet), National Institute of Information and Communication Technology(NICT)] Address [1; 2-2 Yamadaoka, Suita, Osaka, 565-0871 2; 1-4 Yamadaoka, Suita, Osaka, 565-0871] Voice:[1; +81-6-6210-8429, 2;+81- 80-9098-3264], FAX: [+81-6-6210-8430], Email:[1; [email protected], 2;[email protected] ] Re: [] Abstract: [A important use case of dependable body area network(WBAN) for implanted devices is introduced to perform reliable and massive data for implantable brain machine interface to require amendment for IEEE802.15.6 wireless medical body area network.] Purpose: [information] Notice: This document has been prepared to assist the IEEE P802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein. Release: The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by P802.15. November 2019 do cdoc.: ,(((GHS Submission Slide 1 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Upload: others

Post on 21-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

November 2019Project: IEEE P802.15 Working Group for Wireless Personal Area Networks (WPANs)

Submission Title: [WNG Higher speed wireless body area networks are required for implantable brain-machine interfaces]Date Submitted: [18 July 2019]Source: [Masayuki Hirata1, Takafumi Suzuki2] [1; Dept. of Neurological Diagnosis and Restoration, Graduate School of Medicine, Osaka University, 2; Center for Information and Neural Networks(CiNet), National Institute of Information and Communication Technology(NICT)]Address [1; 2-2 Yamadaoka, Suita, Osaka, 565-0871

2; 1-4 Yamadaoka, Suita, Osaka, 565-0871]Voice:[1; +81-6-6210-8429, 2;+81- 80-9098-3264], FAX: [+81-6-6210-8430],Email:[1; [email protected], 2;[email protected]] Re: []Abstract: [A important use case of dependable body area network(WBAN) for implanted devices is introduced to perform reliable and massive data for implantable brain machine interface to require amendment for IEEE802.15.6 wireless medical body area network.]Purpose: [information]Notice: This document has been prepared to assist the IEEE P802.15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein.Release: The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by P802.15.

November 2019 docdoc..::

Submission Slide 1 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 2: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 - 0dep

Higher speed wireless body area networks are required

for implantable brain-machine interfaces

Masayuki HirataDepartment of Neurological Diagnosis and Restoration,

Osaka University Graduate School of Medicine

Takafumi SuzukiCenter for Information and Neural Networks,

NICT

Submission Slide 2 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 3: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0dep

Brain Machine Interfaces

Submission Slide 3 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)ission Slide 3 Masayuki Hirata(Osaka University) Takafumi S

Page 4: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Medical potential of implantable BMIs

Submission 4

107

106

105

104

103

ALS

cervical cord injury

spinal cord injury

amputee

stroke

Performance of BMI

Epilepsy

Swallowing disturbancedisttuurrbbaance

Eppiilleepps

cer

Slide 4 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 5: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Fundamental basis of brain decoding: Brain functions are localized.

Submission Slide 5 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 6: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Brain signals used for BMIs

Submission Slide 6 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 7: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

dB

time (ms)

frequ

ency

(Hz)

2 4 6

2

4

6

8

10

-2

7

2

4

6

2 4 6

2

4

6

8

10

-2

4

Time-frequency distribution Spatial distribution

high frequency band

Low frequency bands

Brain activity during hand movements

central sulcus

high frequency

i ( )Low frequency

focal

diffuse

High frequency brain activity better reflects functional localization than low frequency activity

SubmissionSlide 7 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 8: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Time (s) Time (s)

High frequency brain activity (80-150Hz) offer highest decoding accuracy

TTTTTTTTTTTiiii ( ))))time-frequency spectrogram time-frequency distribution of

decoding accuracy

movement onset Classification by a SVM

activity

Freq

uenc

y (Hz

)

Freq

uenc

y (Hz

)en

cy

Submission Slide 8 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 9: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

ECoG-based real time BMI system (wired)

Submission Slide 9 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 10: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Submission

A clinical research of implantable BMI (wired)

Slide 10 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 11: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Trends in neurosurgical treatments using implantable devices

Submission Slide 11 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Deep brain stimulation(DBS)

Closed loop DBS

Brain machine interfaces(BMI)

stimulation device

multichannel recording device

stimulation device with recoding function

slow

fast

Responsive Neurostimulator(RNS) for epilepsy

400MHzAnalog data com.

2.4 GHzdigital data com.

UWBdigital data com.

very fast

1st generation100ch

2nd generation4000ch

Page 12: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Deep brain stimulation (DBS) for Parkinson diseasePresent representative implantable device for clinical useElectrical stimulation to the deep brain improves Parkinson symptoms

Submission Slide 12 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

DBS for Parkinson diseaseStimulation is independent of brain activityData transfer is limited to setting stimulation condition.

Page 13: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Vagus nerve stimulation for intractable epilepsy

Electrical stimulation to the vagus nerve reduces the frequency of seizure attack.

Submission Slide 13 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Stimulation is independent of epileptic activityData transfer is limited to setting stimulation condition.

Page 14: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Closed loop deep brain stimulation (DBS)

Closed loop DBS stimulates the brain based on recorded brain activity

Submission Slide 14 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Stimulation depends on brain activityData transfer includes a few channels of brain activity.

Page 15: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Responsive neurostimulator (RNS) for intractable epilepsyRNS stimulates epilepsy focus when brain recording detects seizure attack.

Submission

(Sun, Neurotherapeutics, 2008)

Brain recording

Seizure detection

Electrical stimulation

Neuropace

Stimulation depends on epileptic activityData transfer includes a few channels of brain activity.Present 400M Hz analog data transfer satisfies the data transfer demand.

Slide 15 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 16: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Implantable brain machine interface (BMI) Implantable BMIs control robotic arms and communication devices based on recording and decoding of multi-channel brain activity.

Submission Slide 16 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)How fast do implantable BMIs require for wireless data transfer?

Page 17: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Time (s) Time (s)

High frequency brain activity (80-150Hz) offer highest decoding accuracy

1000 Hz sampling rate is required for recording.

TTTTTTTTTTTiiii ( ))))time-frequency spectrogram time-frequency distribution of

decoding accuracy

movement onset Classification by a SVM

activity

Freq

uenc

y (Hz

)

Freq

uenc

y (Hz

)en

cy

Submission Slide 17 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 18: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Freq

uenc

y(H

z)

Time (s)-1.5 -1 -0.5 0 0.5

020406080

100120140160180

dB

-4

-2

0

2

4

-2000 -1500 -1000 -500 0 500 1000-8

-6

-4

-2

0

2

4

6

8

chan001

chan002

chan003

chan004

chan005

chan006

chan007

chan008

chan009

chan010

chan011

chan012

chan013

chan014

chan015

chan016

chan017

chan018

chan019

chan020

chan021

chan022

chan023

chan024

chan025

chan026chan027

chan028

chan029

chan030

chan031

chan032

chan033

chan034

chan035

chan036

chan037

chan038chan039

chan040chan041

chan042

chan043

chan044

chan045

chan046

chan047

chan048

chan049

chan050

chan051

chan052

chan053

chan054

chan055

chan056

chan057

chan058

chan059

chan060

chan061

chan062

chan063

chan064

chan065

chan066

chan067chan068

chan069chan070

chan071

chan072

chan073

chan074

chan075 chan076

chan077

chan078

chan079

chan080

chan081

chan082

chan083

chan084

chan085

chan086

chan087

chan088

chan089

chan090

chan091

chan092

chan093

chan094

chan095

COMNT

Freq

uenc

y(H

z)

Time (s)

-1.5-1-0.50 0.5

0

100

200

dB

-4-2024

in a single trial

Spectrogram of

ECoG ranges from 1

104 order range = 14 bit recording is required

hand knob area

Slide 1 8 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 19: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

No. of recording channels depends on inter-electrode spacing and recording areas to be covered.

100 ch is required to cover 3cm2

Submission Slide 19 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Standard clinical ECoG electrodesInterelectrode spacing 10mm

High density ECoG electrodes for implantable BMIsInterelectrode spacing 3mm

Page 20: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0dep

Requirement for data transfer speed of implantable BMI

1st generation:

Sampling rate: 1000HzChannel number: 100ch(Interelectrode spacing: 3mm, coverage 3cm2)

Data transfer speed:14 bit x 1000 Hz x 100 ch = 1.6 Mbps

Submission Slide 20 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

2nd generation:

Sampling rate: 1000HzChannel number: 4000ch(Interelectrode spacing: 1mm, coverage 3cm2 X 4)Data transfer speed:14bit x 1000 Hz x 4000 ch = 64 Mbps

Page 21: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0depNovember 2019

Trends in neurosurgical treatments using implantable devices

Submission Slide 21 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Deep brain stimulation(DBS)

Closed loop DBS

Brain machine interfaces(BMI)

stimulation device

multichannel recording device

stimulation device with recoding function

slow

fast

Responsive Neurostimulator(RNS) for epilepsy

400MHzAnalog data com.

2.4 GHzdigital data com.

UWBdigital data com.

very fast

1st generation100ch

2nd generation4000ch

Page 22: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0dep

Submission

Summary

Potential medical market of implantable BMIs is promising.

Implantable BMIs require higher speed ( 102Mbps) and secure wireless communication.

Submission Slide 22 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)

Page 23: November2019 docdoc..: : ,((( GHS …...Closed loop DBS Brain machine interfaces (BMI) stimulation device multichannel recording device stimulation device with recoding function slow

doc.: IEEE 802.15-19-0 -0dep

Submission

Thank you for your attention

Submission Slide 23 Masayuki Hirata(Osaka University), Takafumi Suzuki(NICT)