nick van helleputte - semi...• motion artifact reduction • data compaction techniques •...

36
Nick Van Helleputte Wearables for novel healthcare paradigms R&D manager biomedical circuits & systems - imec

Upload: others

Post on 23-Apr-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Nick Van Helleputte

Wearables for novel healthcare paradigms

R&D manager biomedical circuits & systems - imec

Page 2: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Chronic disease management

Page 3: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Chronic disease example: United states

50% of all adults

117 million americans suffer from one or more chronic

diseases.

Page 4: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

33% of all adults

CHRONIC DISEASE EXAMPLE: EUROPE

Page 5: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

5

CHRONIC OBSTRUCTIVE PULMONARY DISORDER

3rd cause of death in Europe ; 600 000 deaths related to pulmonary diseases

COPD is 10th cause of death in Japan ; pneumonia (+ influenza) is 1st cause of death in Japan

TODAY THERE ARE VERY LIMITED TOOLS TO MONITOR THESE PATIENTS AT HOME

Page 6: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Sleep apnea

3-7 % of middle-aged men and 2-5 % of middle-aged women suffer from sleep apnea

9 % of Japanese men and 2.8 % of Japanese women suffer from sleep apnea

medically relevant sleep apnea – meaning at least five to ten breaths are missed per

hour – does not only make you (permanently) tired, lacking in motivation and

exhausted, but has serious consequences for your health

6

Page 7: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Congestive heart failure

38% of all deaths in Europe are due to cardio (or cerebro) vascular disease

24 % of all deaths in Japan are due to cardio (or cerebro) vascular disease 7

Page 8: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

HYPERTENSION

31% of all people in Japan have hypertension

ONLY 12% OF ALL PATIENTS CHANGES HIS/HER LIFESTYLE

9-20 % of all adults and 40-60% of all elderly in Europe have hypertension

Page 9: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Chronic Kidney Disease

9

Relevant parameters to monitor

Page 10: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Key to improving quality of life

Role of Wearables for chronic disease management

10

Early, affordable and reliable diagnosis

Disease progressionmonitoring

Personalized therapyand lifestyle change

Need for multi-modal, ultra-low-power signal acquisition platforms sensor fusion algorithms Personalized and contextualized data analytics

Page 11: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Gyroscope

Multi-modal wearables

Page 12: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Multi-modal wearables

• Heart rhythm and HRV

• Respiration patterns

• Body water composition

• Physical activity

• Core body temperature

• Blood pressure

• Blood oxygenation (SpO2)

• Breath analysis (CO2, NOx, ...)

• Body sounds

• ...

• Sensor fusion algorithms

• Artefact reduction

• Feature extraction and classification

• Personalized & learning algorithms

Page 13: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

13

These wearables BUILD on circuit innovations

CFBIAinp

inn

vpfb

vnfb

Cdm

+

-gm1

CcmTIfb

CFBIA+

-gm2

Ccm

TITI2

TIfb

n1-n1+

Vop1 Von1

Vop1Von1

Vx1 Vx2

Vcp

Vbn

gm1

TIfb1

outp

outn

TI1

OUTp

Vop1 Von1

TI1

Vcp

Vop2 Von2

OUTn

OUTn

Tail current reuse

TI2

n1-

Isig

Vcn

Vcn

Le

ve

l sh

ift

Le

ve

l sh

ift

Vcp Vcp

n1+

n1-

n2+

n2-

DC-servo

Page 14: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Vision & Ambition

Next generation ASICs are key enablers

14

Page 15: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Dedicated analog front-ends

Next generation ASICs are key enablers

15

Ultra-low power, high quality, robust, small analog front-end circuits

• Electrocardiogram (ECG)• Bio-impedance (BioZ)• Electroencephalogram (EEG)• Galvanic skin response (GSR)• Photoplethysmograph (PPG)• ...

Page 16: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Ultra-low-power signal processing

Next generation ASICs are key enablers

16

On the node ULP signal processing to minimize wireless power consumption

• Data synchronization• Feature extraction and

classification• Motion artifact reduction• Data compaction

techniques• Contextual awareness• Personalized machine

learning algorithms

Page 17: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Highly efficient power management

Next generation ASICs are key enablers

17

Highly power-efficient, low quiescent current power management

• Linear regulators for high accuracy analog blocks

• Switched regulators for digital with support for DVFS

• SIMO & capless topologies for a highly integrated solution and less external components

• Optimized efficiency for low average output power levels

• Support for novel battery technologies

Page 18: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Wireless connectivity

Next generation ASICs are key enablers

18

Wireless connectivity to leverage the power for the cloud

• Optimized ULP radio links with very low standby current

• Compatible with existing infrastructure for rapid user adoption and wide deployability

Page 19: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

multi-sensor interface

embedded signal processing

power management

radio

(data) security

Security as early as possible in the signal acquisition chain

Next generation ASICs are key enablers

19

Medical data is sensitive!Medical devices are potentially life critical

• Guarantee data security through immediate on-the-node encryption

• Prevent tampering with the device by secure embedded software

Page 20: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

MUSEIC V2 currently available for development projects

Dedicated AFEs

ECG

PPG

BioZ

GSR

Integrated PMU

Fully battery powered

General purpose DSP

ARM Cortex M0+

HW accelerators

MAU

Samplerate converter

timestamp

Embedded memory

192Kbit SRAM

LED drivers

Fully battery powered

Typical power (data-collection ECG + BIOZMF + PPG)

Digital (@0.6V) Analog (@ 1.2V) Total

103uW 195.4uW 298.4uW

DIVERSE applications enabled by IMEC’s uLP museic CHIPS

Page 21: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

BEYOND WEARABLES: non-contact health sensing

CAPACITIVE SENSING(through textile)

RADAR SENSING(remote)

OPTICAL SENSING(remote & wearable)

Sensor fusion

Page 22: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

BEYOND WEARABLES: non-contact health sensing

S1

S2

S3

S4

Multi-location capacitive ECG sensing through bed linen

Page 23: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

BEYOND WEARABLES: non-contact health sensing

Capacitive Bio-impedance based Respiration rate + depth sensing through shirt and sweater

CAPACITIVE SENSING(through textile)

Page 24: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

BEYOND WEARABLES: non-contact health sensing

Heart rate and respiration rate extracted from 2 meters distance using radar

Subject 1

Subject 2Respiration+HR

HR only

Respiration+HR

HR only

Page 25: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

ECG SIGNAL

ACCELEROMETER SIGNAL

GYROSCOPE SIGNAL

ECG SIGNAL

ACCELEROMETER SIGNAL

GYROSCOPE SIGNAL

Example: driver monitoring

Page 26: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Towards disease prevention

Page 27: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Personal behavioral technologyWE PERFORM DIGITAL PHENOTYPING BASED ON CONTEXTUAL AND PHYSIOLOGICAL DATA

FROM LARGE-SCALE TRIALS AND CREATE NEW TOOLS FOR PERSONALIZED BEHAVIOR CHANGE

Learn behavior & habits & cravings

Find patterns & triggers

Give the right recommendation at the right timeOngoing trials: stress & mental health, smoking cessation, eating

disorders

Rich physiological information (120 statistical parameters)

Diverse contextual information (smart-phone data & self reported)

Unsupervised learning algorithms

Page 28: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

28

DIGITAL PHENOTYPE

For increasedPERSONALIZATION and

BEHAVIOR change

Page 29: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Digital phenotyping: stress as a use case scenario

WEARABLE AND CONTEXTUAL INFORMATION FOR STRESS DETECTION

29

CHEST PATCH

ECGAcceleration (3 dim)

QUESTIONNAIRES

StressActivity

Food/beverage intakeSleep

Gastro-intestinal symptoms

LOCATION

ContinuousDuring questionnaires

VOICE PHONE DATA

ProximityAccelerationStep count

Screen on/offAmbient lightTemperature

Humidity...

WEARABLES SMARTPHONE DEMOGRAPHICS

CHILLBAND

Skin conductance (SC)Temperature

Acceleration (3 dim)

Page 30: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Sweet study – stress in the work environment

LARGE SCALE DATASET WITH CONTEXT AND PHYSIOLOGICAL DATA

945 SUBJECTS 11 COMPANIES

23,000 SELF-REPORTED STRESS

RESPONSES

5 TB DATA

95,000 HOURS PHYSIOLOGICAL DATA

AND COUNTING ...

Page 31: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Stress physiology

THE FLIGHT OR FIGHT RESPONSE

Jvnkfood, CC BY-SA

Page 32: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

A personalized stress modela combination of physiological signals and contextual information

Context model

Activity

• Intensity

• Frequency

Smartphone

• Usage times

• Usage patterns

Social contacts

• Number

• frequency

Location

• Regularity

• Connection to stress

Speech

• Prosody (intonation, tone, rhythm)

• Sound level

Ambient sound

• Noise level features

Sleep

• Time

• Quality

Physiologicalmodel

ECG• HR

• HRV (SDNN, RMSSD, pNN50, HF, LF, …)

GSR• SCR

• SCPH

• SCL

• OPD

• …

Skin temperature• Temp slope

• mean Temp

Respiration• Frequency

• Tidal volume

• …Stres

s

A unique

personalized

algorithm

correlating your

physiological

signals

(and context)

to your stress

Page 33: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Age as identifier of physiological stress dynamics

∆ H

R f

eatu

re

∆ S

C f

eatu

re

∆ S

T fe

atu

re

NEGATIVE CORRELATION between AGE and the DYNAMICS of the

PHYSIOLOGICAL stress response

Age Age Age

RIGID physiological stress response

INTERMEDIATE physiological stress response

DYNAMIC physiological stress response

Page 34: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

Chronic depression levels as identifiers of physiological stress dynamics

∆ H

R f

eatu

re

∆ S

C f

eatu

re

∆ S

T fe

atu

re

Depression level Depression level Depression level

NEGATIVE CORRELATION between DEPRESSION LEVEL and the DYNAMICS of the PHYSIOLOGICAL

stress response

RIGID physiological stress response

INTERMEDIATE physiological stress response

DYNAMIC physiological stress response

Page 35: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

35

FUTURE

Include CONTEXT information formodeling and feedback

Develop ‘types of users’ or ‘PERSONAS’ based on

physiology

Just-in-time FEEDBACKPERSONALIZED MODELS todetect stress

DIGITAL PHENOTYPING for PERSONALIZED BEHAVIOR CHANGE

Page 36: Nick Van Helleputte - SEMI...• Motion artifact reduction • Data compaction techniques • Contextual awareness • Personalized machine learning algorithms. multi-sensor interface

• The role of wearables for chronic diseases may become key to improve the quality of life

Not only as passive data loggers

But more as an active contributor to wellbeing

• Multi-modal, ultra-low-power signal acquisition ASICs with powerful integrated digital signal processing support is the trend in these wearables

Digital filtering

Machine learning

Context aware / personalization

• Wearables will become instrumental towards active disease prevention and behavioral change

Summary

36