mirror neurons and human telemetry for rehabilitation · and human telemetry for rehabilitation ......
TRANSCRIPT
Mirror Neurons
and Human Telemetry
for Rehabilitation
ALESSANDRO LOMBARDI, DIGITAL ADVISOR | ITALY
KHARE
TH
E T
EA
M
2
The team: Microsoft
Microsoft enables health sector’s digital transformation by
helping care organizations better engage patients, empower
care teams, optimize clinical and operational effectiveness, and
transform the care continuum.
Alessandro
Lombardi
Digital Advisor
Luca
di Biagio
Solution Architect
Paolo
Mele
Sr Consultant
Pedro
Fortes
Sr Consultant
Saverio
Guardato
Consultant
Roberto
Robustelli
Delivery Manager
TH
E T
EA
M
3
The team: INAIL
Crucial for them to help people get back to work as soon as
possible
TH
E T
EA
M
4
The team: University of Parma
Mirror neuron discovery and continued research
20141995
How it all began
5
The “innovation hack”
“What a piece of work is a man! How noble in reason,
how infinite in faculty! In form and moving how express
and admirable!”
- William Shakespeare
Meet Gotz:
he got hurt
Happiness
Reassurance
Hope
Fear
Meet Hans:
he is Gotz doctor
Happiness
Empowered
Gives
personalized
care
Unfulfilled
Meet the real Gotz
10
What is KHARE?
TechnologyNeuroscience
Medical expertise
• Average decrease of healing timesand increased movement functionality; movements quality, from the most approximate to the most refined ones, for the normal daily activities through the ones needed for working.
• Increased number of rehabilitations services that are distributable by a single health structure and subsequent costs reduction for the patients and the healthcare system.
mainly because of the rehab treatment continuum, given by the relationship between the patient and the health structure that initially took the patient, rehabilitation is also obtained with the right psychological contribution.
What are the advantages
of KHARE?
“Knowledge should be seen as
networked communication.”
- Esko Kilpi
Empathy
Trigger of
mirror
neurons
AOTProximal
approach
13
The SCIENCE factor
The
video
stimulus
Intensity
Human
telemetry
Predictive
human
telemetry
14
Definitions
of
indicators
The TECH factor
15
The HUMAN factor
INAIL CRM
Volterra
16
KHARE as a platform
“All our dreams can come
true, if we have the courage
to pursue them.”
- Walt Disney
COLLECTdata from the patients while they
are executing their physical therapy exercises
TRANSFORMdata into a
standardized format
MANAGEdata as real-time streams and
store as relational or non-relational datasets
in the cloud
ANALYZEand predict with machine
learning and custom queries and algorithms
VISUALIZEthrough dashboards,
reports to easily study data
DECIDEThe doctorswill be able
to increase the therapies effectiveness
IOT HUB
Stream
analyticsAzure
StorageEvent
HUB
Api AppMachine
Learning
• Windows 8.1 app (Kinect SDK)
• Event Hub to collect data from Kinect in real time
• Table storage
• Integration with Microsoft Band
• Measure angles and distances between joints
• Create complex exercises
• Measure quality
App
Features
The proof of concept, scope
The proof of concept, data sheet
Input ValuesAverage message size
every secondNumber of captured Joints
Average length of rehab
session (active time)
45.000 bytes 25 30 minutes
Average data size per
rehab sessionAverage data size per hour Therapy length
81 MB 162 MB 20 sessions per patient
Information per year
Number of expected
patientsTotal sessions Total ingested data
50.000 1 M 81 TB
23
Moving on with INAIL
Medical Experimentation set up (2016)
DCOD (IT) department focuses on building a
Minimum Viable Product to be used in
experimentation
Rehabilitation department finalizes the new
medical protocol for AOT with Parma
Video preparation
Medical Experimentation (2017)
CRM Volterra starts experimentation
according to the new protocol on a controlled
group with the support of Parma
Technological POC
Envisioning
ForumPA divulgation
Analysis and design
Implementation and release
“Empower every
person and every
organization on the
planet to achieve
more.”
- Satya Nadella
Next goal: extending telemetry
Measuring strength and fine finger detection
Human telemetry: going beyond rehab.
Empowering every human to improve performances and
learn new skills
