implementation of tele- rehabilitation system combined ...€¦ · –a call center operator guides...

18
ITU Kaleidoscope 2016 ICTs for a Sustainable World Implementation of Tele- Rehabilitation System Combined with Video Call Center Kotaro Suzuki Iwate Prefectural University Graduate School [email protected] Bangkok, Thailand 14-16 November 2016

Upload: others

Post on 09-Aug-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

ITU Kaleidoscope 2016ICTs for a Sustainable World

Implementation of Tele-Rehabilitation System Combined

with Video Call Center

Kotaro SuzukiIwate Prefectural University Graduate School

[email protected]

Bangkok, Thailand14-16 November 2016

Page 2: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Background (1)

• Low birthrate and rapidly aging population are;

– causing medical expenses to take up ever more of the national budget.

– leading to a shortage of young medical

professionals.

• Medical treatments, including rehabilitation, are being shifted from hospital-care to home-care.

• The amount of rehabilitation therapy in a home

done by a visiting physiotherapist is limited by law and is insufficient for patients to recover completely.

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 3: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Background (2)- Duration of feeding period -

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000To

tal p

oin

ts o

f N

HI

Cardiovascular

Cerebrovascular

Locomotorium

Respiratory

Days after starting treatment

It is difficult for patients to continue

rehabilitation by themselves.

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 4: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• Our system has following two features to help patients continuously:

– A patient can check data to see the effect of

rehabilitation. This time, we use Microsoft KINECT to measure strain of the upper body.

– A call center operator guides patients through

the therapy and encourages them with conversation through the Internet.

Background (3)

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 5: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• Tele-rehabilitation system combined with a video call center

– Behalf of a physiotherapist, call center

operators guide patients through the therapy and encourages patients with their voice.

– Medical expense will be suppressed.

• Personal expenses will decrease

• Transportation cost will decrease

Purpose (1)

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 6: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• Practical data that shows the patients

getting better will more effectively

encourage them to continue rehabilitation.

• Hearing a person’s voice is likely to cheer

patients up.

Basic idea to continue rehabilitation

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 7: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Concept of the tele-rehabilitation system

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Data

OperatorPatient

Administration tools

Supervising tools

RDBMS

Video Call center

Supervisor:Physiotherapist

Voice

Data

DataTherapycontents

Comm. Exchange prg.

Measuring tools

Data for patients

Page 8: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Implementation- Communication exchange program -

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

CCS

Log in

SkyWay

peerID

Log in

peerID

SkyWay

Matchingref

Voice path

Data path

Data path

Log in

Data path

peerID

SkyWay

Matchingref

Voice path

Page 9: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Implementation- Measuring tool -

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

9

CCS

Wake up KINECT control app.

App.waking up

Video image data

Skeleton data

Web viewgenerating

Video image & Skeleton

Video image & Skeleton

Measuring

Measuring Start/End

Video image & Skeleton

Measured data(Temp.)

Contentchecking

Store

Measured data(Archived)

Page 10: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Training scene for a patient

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

MS-KINECT

Patient-PC

Page 11: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Screenshots from a patient-PC and an operator-PC

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

(a) Screen shot of a patient-PC (b) Screen shot of a patient of an operator-PC

Left Right

Up

Front view

Side view

Top view

Page 12: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Implementation- Communication image at a patient-PC -

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Login operators list

Opponent camera image your camera image

Page 13: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Implementation- Searching tool : E-R Diagram-

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Operator_ID

Employment_dateBirthdayAddressMail_addressPhone_number

Patient_ID

Employment_dateBirthdayAddressMail_addressPhone_number

[Patient table]

[Operator table]

Auto_ID

Stored datePatient_IDOperator_IDCommentMeasured/Archived Directory_path.

Auto_IDBookmark_ID

Start flame numberEnd flame number.

[Data management table]

[Bookmark table]

Page 14: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Implementation- Replaying tool -

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Bookmark buttonsSeek-bars

Data list

Page 15: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

Effect for shortage of physiotherapist in TRS

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

0

2

4

6

8

10

12

3 4 5 6 7 8 9 10 11 12 13 14 15

So/Sp = 1/3

So/Sp = 1/5

So/Sp = 1/7

The number of operators that a physiotherapist supervised

The

nu

mb

er o

f p

atie

nts

th

at

a p

hys

ioth

era

pis

t ca

n d

eal w

ith

in o

ne

ho

ur

usi

ng

TRS.

Page 16: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• We developed a tele-rehabilitation system that enables a video call center operator to coach a patient

in place of a physiotherapist and a physiotherapist to supervise multiple operators.

• We believe the proposed system will help to suppress the increase of medical expenses and make up for the shortage of young medical professions caused by low

birthrates and rapidly aging populations.

Conclusion

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 17: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• For healthcare insurance to cover it, TRS has to be approved by the government department in charge of healthcare.

• The national healthcare insurance in Japan covers only face-to-face rehabilitation, not tele-rehabilitation. Thus, TRS will need to be licensed for the national healthcare insurance to cover it.

• If a license cannot be obtained, a new business model will be needed for business operators to continue this business.

• Criteria for evaluation are needed to maintain service quality. At the very least, criteria an operator has to learn are needed.

• Standardization of protocol for training contents or tools to connect TRS.

Problems to putting TRS on the market

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World

Page 18: Implementation of Tele- Rehabilitation System Combined ...€¦ · –A call center operator guides patients through ... Wake up KINECT control app. App. waking up Video image data

• Thank you for attentions.

• Questions?

Bangkok, Thailand, 14-16 November 2016

ITU Kaleidoscope 2016 - ICTs for a Sustainable World