development and validation of a breakthrough ai-guided

23
1 Development and Validation of a Breakthrough AI- Guided Echocardiography System Ha Hong, Ph.D. Founding Team Member

Upload: others

Post on 29-May-2022

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development and Validation of a Breakthrough AI-Guided

1

Development and Validation of a Breakthrough AI-Guided Echocardiography System

Ha Hong, Ph.D.Founding Team Member

Page 2: Development and Validation of a Breakthrough AI-Guided

Prelude: understanding and emulating the brain

Image

“Airplane”

Behavioral ReportDecoding

Neural Responses

Neuron 1Neuron 2Neuron 3

Encoding

...

...

Page 3: Development and Validation of a Breakthrough AI-Guided

Prelude: understanding and emulating the brain

Image

“Airplane”

Behavioral ReportDecoding

Neural Responses

Neuron 1Neuron 2Neuron 3

Encoding

Yamins*, Hong*, Cadieu, et al.,Adv Neural Inf Process Syst, 2013

Cadieu, Hong, et al.,PLOS Comput Biol, 2014

Hong*, Yamins*, et al.,Nature Neurosci, 2016

Page 4: Development and Validation of a Breakthrough AI-Guided

● 600,000 deaths in the U.S.

● 17.9 million deaths globally.

● Many conditions are treatable or preventable: early and accurate detection and diagnosis are key.

● Medical imaging is the gateway to detection and diagnosis.

● Ultrasound is effective with many advantages.

Too many people are dying from heart disease

Caption Health™ 2020

● Images most organs

● Low risk

● Images in real-time

● Small and low cost devices“The stethoscope of the future”

Page 5: Development and Validation of a Breakthrough AI-Guided

Heart disease can be accurately diagnosed with echocardiography.However, often this happens too late.

Cardiac ultrasound today

Heart Disease Symptoms Physical

ExamImage Acquisition Diagnosis Treatment

Caption Health™ 2020

Page 6: Development and Validation of a Breakthrough AI-Guided

The problem: Ultrasound is hard to use

UNINTUITIVE IMAGES

UNNATURAL HAND -EYE COORDINATION

EVERYBODY IS DIFFERENT

Caption Health™ 2020

With AI, is it possible to make anultrasound navigation system for everyone?

Page 7: Development and Validation of a Breakthrough AI-Guided

We developed AI-based heart ultrasound guidance technology that can empower healthcare providers to acquire high quality ultrasound exams.

Caption Health™ 2020

Page 8: Development and Validation of a Breakthrough AI-Guided

Emulating the intuition of imaging experts

The guidance technology predicts the deviation of the current transducer positioning from the ideal positioning in real time.

The software then provides the user instructions to efficiently minimizethe deviation.

Idealposition

IdealPositioning

CurrentPositioning

Caption Health™ 2020

Page 9: Development and Validation of a Breakthrough AI-Guided

Emulating the intuition of imaging experts

The guidance technology emulates imaging experts:

1. It recognizes the current transducer positioning from input image.

Caption Health™ 2020

Page 10: Development and Validation of a Breakthrough AI-Guided

Emulating the intuition of imaging experts

The guidance technology emulates imaging experts:

1. It recognizes the current transducer positioning from input image.

2. It predicts the target ideal positioning and provides the user the instruction to reach the ideal.

Caption Health™ 2020

Page 11: Development and Validation of a Breakthrough AI-Guided

Emulating the intuition of imaging experts

The guidance technology emulates imaging experts:

1. It recognizes the current transducer positioning from input image.

2. It predicts the target ideal positioning and provides the user the instruction to reach the ideal.

3. It recognizes when the user reaches the target, getting diagnostic image.

Caption Health™ 2020

The AI guidance software was accepted into FDA’s Breakthrough Devices Program in 2018

● Provides more effective diagnosis ofa life-threatening or irreversibly debilitating disease or condition

● No approved or cleared alternatives

Page 12: Development and Validation of a Breakthrough AI-Guided

Initial verification andpilot study

Caption Health™ 2020

Page 13: Development and Validation of a Breakthrough AI-Guided

Verification of the guidance technology

Caption Health™ 2020

Performance assessment with a panel of 5 human experts● 2 level III cardiologists● 3 imaging experts

Is the quality of the clip suitable for

diagnostic purposes?

...

...

Page 14: Development and Validation of a Breakthrough AI-Guided

Verification of the guidance technology

The performance of the guidance technology in recognizing diagnostic quality images was evaluated by a panel of five experts.

Perf

orm

ance

(Are

a un

der t

he R

OC

cur

ve)

1.0

0.8

0.6

0.4

0.2

0.0

AP2

AP3

AP4

AP5

IVC

PLAX

PSAX

-AV

PSAX

-MV

PSAX

-PM

SubC

4

MedianAI guidance

95% CI

Caption Health™ 2020

Page 15: Development and Validation of a Breakthrough AI-Guided

Verification of the guidance technology

The performance of the guidance technology in recognizing diagnostic quality images was evaluated by a panel of five experts.

Perf

orm

ance

(Are

a un

der t

he R

OC

cur

ve)

1.0

0.8

0.6

0.4

0.2

0.0

AP2

AP3

AP4

AP5

IVC

PLAX

PSAX

-AV

PSAX

-MV

PSAX

-PM

SubC

4

MedianAI guidance

95% CI

Human expert

Caption Health™ 2020

Page 16: Development and Validation of a Breakthrough AI-Guided

Testing with pilot study

Subjects● Range of BMI:

○ Obese: 30+ BMI○ Overweight: 25-30 BMI○ Normal: 18.5-25 BMI

● Presence of Pathology:○ Aortic valve replacement○ Mitral valve repair○ Atrial enlargement○ Dilated cardiomyopathy○ Conduction disease w/

pacemaker● Older Population, Gender

Balanced: ○ Median Age: 50○ Male 56%, Female 44%

Caption Health™ 2020

Imaging experts● More than 5 years of

professional experience● Acquiring exams of 10

views without the AI-guidance

Registered Nurses ● 2-day training:

○ 1 hour didactic○ 4 hours of practice

● Independently acquiring exams of 10 views with the AI-guidance

Performance assessment with a panel of Level III cardiologists● Randy Martin, CMO,

Caption Health● Neil Weissman,

MedStar Health● Jim Thomas,

Northwestern University● Alan Pearlman,

University of Washington● Akhil Narang,

Northwestern University

Can the exam be used to qualitatively assess the following clinical parameters?

Page 17: Development and Validation of a Breakthrough AI-Guided

Testing with pilot study

Clinical Parameter

LV Size

LV Function

RV Size

Pericardial Effusion

% Diagnostic RN exams

98%

98%

92%

98%

Caption Health™ 2020

Page 18: Development and Validation of a Breakthrough AI-Guided

Testing with pilot study

Clinical Parameter

LV Size

LV Function

RV Size

Pericardial Effusion

% Diagnostic RN exams

98%

98%

92%

98%

Caption Health™ 2020

Narang, Hong, et. al.,Am Soc Echocardiogr, 2019 Pearlman, Narang, Hong, et. al.,

Eur Heart J, 2020

Page 19: Development and Validation of a Breakthrough AI-Guided

Validation withlarge-scale, prospective clinical trial

Caption Health™ 2020

Page 20: Development and Validation of a Breakthrough AI-Guided

Validation with prospective clinical trial

Clinical Parameter

LV Size

LV Function

RV Size

Pericardial Effusion

Performance Target

8 0 %

8 0 %

8 0 %

8 0 %

RN Achieved Performance (95% CI)

98.8% [97.6%, 10 0 %]

98.8% [97.6%, 10 0 %]

92.5% [8 8 .1%, 96.9%]

98.8% [97.7%, 10 0 %]

Two-center clinical study

● 240 hospital patients

● 8 nurses

● Each nurse received minimal training, then independently scanned 30 patients with the AI-guidance

● Stratification on ranges of BMI

● Stratification on presence of cardiac pathology

Caption Health™ 2020

Caption Guidance granted De Novo earlier this month

● Regulatory pathway for novel low-to-moderate risk devices

● First AI-guided image acquisition software cleared/approved

Page 21: Development and Validation of a Breakthrough AI-Guided

The AI -g u id ed im a g e a c q u is ition tec h n olog y em u la tes th e sk ills of exp erts to em p ow er fron t lin e h ea lth c a re p rovid ers .

Th e tec h n olog y d em on stra ted sa fety a n d effec tiven ess w ith exten sive tests .

W e h op e to see su b sta n tia l in c rea se in a c c ess to ec h o in c lin ic a l settin g s w h ere it u sed to b e im p ra c tic a l or im p ossib le .

Caption Health™ 2020

Page 23: Development and Validation of a Breakthrough AI-Guided