220 klyce newparadigmfin - wavefrontcongress.org · smartphones in ophthalmology • external...

40
20 min

Upload: others

Post on 17-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

20 min

Page 2: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Relevant Financial Relationships

Consultant to:Intelligent DiagnosticsNIDEKNTK EnterprisesOculus (spouse)

Page 3: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

SMARTPHONE EVOLUTION

• Legacy ophthalmic instruments were powered by PC’s for 3+ decades

• Apple releases its 1st iPhone in 2007• iPhone 3 + 1st Android released in 2008• By 2016 mobile device sales > desktops

Page 4: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

WHY SMARTPHONES?

Widespread commercialization enables:• Low cost• Ultrahigh resolution imaging• Computational power• Multiple communication avenues• Virtually unlimited data storage

Page 5: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

SMARTPHONES IN OPHTHALMOLOGY• External photography• Fundus imaging• AI – based screening for D.R.• Front end to tele-ophthalmology• Remote sensing, diagnostics• Monitoring patients at home• Scheduling, billing

• Etc, etc

Page 6: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Current Measurement Technologies

Reflection:A. Mire PlacidoB. Grid

InterferometryC. OCT

Slit scanD. Scheimpflug

Page 7: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Reflection:A. Mire PlacidoB. Grid

InterferometryC. OCT

Slit scanD. Scheimpflug

Current Measurement Technologies

Page 8: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Cassini – Endothelial Astigmatism

Page 9: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Reflection:A. Mire PlacidoB. Grid

InterferometryC. OCT

Slit scanD. Scheimpflug

Current Measurement Technologies

Page 10: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Reflection:A. Mire PlacidoB. Grid

InterferometryC. OCT

Slit scanD. Scheimpflug

Current Measurement Technologies

Page 11: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Current Measurement TechnologiesPlacido

Oculus Keratograph 5M Medmont E300

Page 12: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Current Measurement TechnologiesPlacido + Aberrometry

NIDEK OPD-Scan 3Visionix VX120

Page 13: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Topography (both surfaces w/cyl) and pachymetry

Current Measurement TechnologiesSlit Scan + Placido

TMS-5Galilei G4 Sirius

Page 14: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Current Measurement TechnologiesSlit Scan + Axial Length ± Placido

Pentacam AXL + WaveAladdin HW3.0 Galilei G6

Page 15: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Challenges for Screening Algorithms• Lack of standard imaging• Many corneal topography models• Different Placido targets• Using tomography in place of topography

• Many different fundus cameras• Different resolutions• Varying exposure, white balance, etc

Page 16: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Fundus Screening

Page 17: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Cone target, fine mire Variations in mire geometry

Large target, coarse mire

Page 18: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Variations in mire geometry

Page 19: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Make a device-independent classifier for corneal topography to reduce the guesswork in interpretation of topography maps.

CHALLENGE

Page 20: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Use 2D FFT to formulate a Butterworth filter for spatial filtering

METHOD

Page 21: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

DETERMINE 2DFFT CUTOFF

Spatial domain Frequency domain

Page 22: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

• Map filtered data onto a standardized ring structure using bilinear interpolation

• Extract topographic indexes• Train AI screener on wide mire set• Test with fine mire set

METHOD

Page 23: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Keratoconus Severity Index – KSI = 61.1%

Page 24: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

VALIDATION IS CRITICAL

0

10

20

30

40

50

60

70

80

90

100

NRM AST KCS KC PMD PKP MRS HRS OTH

SensitivitySpecificityAccuracyP

ercent

Category

Page 25: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Paradigm Shift from Legacy Instrumentswith a Smartphone

• Low cost topographer• Allow wide distribution to referral network• Efficient, portable, space saving (slit lamp mount)• Store exams in the cloud• Very large aggregate database of standardized exams for AI screener

Page 26: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Delphi

Slit lamp mounted, joystick enables +/- 25 µm z-axis positional accuracy for +/- 0.1 D power accuracy

Page 27: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Ergonomically similar to slit lamp with angled components.

Delphi

Page 28: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Smartphone-Based Topography – Alpha Prototype

Pending FDA approval

Page 29: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Comfortable, even, diffuse illumination, pleasing to look into, no flash

Delphi

Page 30: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

PLACIDO REFLECTANCE

Placido Design

• Soft, even ring illumination• No flash, no photophobia.

• Good area coverage• 28 rings, 56 ring edges,

20,160 points• Small central ring - 230µm

CONFIDENTIAL

Page 31: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Magellan Delphi

0.2 mm0.5 mm

Placido Design

Page 32: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Auto-captureRepeat Alignment: 20.6 ± 8.1 µm

Page 33: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

SMART PHONE APP

• Home Screen• Enter Patient Data• Align and Auto-capture

Image• Verify• View OS, OD Maps

Page 34: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Image Processing

Edge Detection & Axial Mapping will run on smartphone• Can Display results

even in Wi-Fi outage• And/or power outage• Sends image + data

file to cloud when Wi-Fi up

Page 35: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &
Page 36: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Basic System Architecture

SmartphoneHardware + dedicated phone Auto-Capture, Edge Detect.Basic Mapping (axial power)

Cloud ServerData Storage & Retrieval Advanced Mapping & DisplayAI-based analytics Aberrometry & Ray TracingHIPAA & GDPR Compliant Difference Mapping

Provider Logintablet , laptop, desktop

Low costSpace saving

Page 37: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Tele-Ophthalmology

Big Data AccessAI development of smarter

screening algorithms

Cloud ServerData Storage & Retrieval Advanced Mapping & Display

HIPAA & GDPR Compliant

Remote ManagementPatient transfer/TriageSecond Opinion Consults

Virtual Screenings

Page 38: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Screening topography• Exam captured in clinic• Results sent to cloud• AI system interprets• Reviewed on line

remotely

Virtual Corneal Topography Screening

Page 39: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

• Meets current needs for Advanced Corneal Topography• Smart Screening• Dry eye diagnostics

• Paradigm shift from legacy diagnostic instruments:• Efficiency - portable, space saving (slit lamp mount)• Low acquisition cost ~$1K per unit• Networked, a Cloud-based storage• Medical big data availability in the digital health era

Delphi

Page 40: 220 Klyce NewParadigmFIN - wavefrontcongress.org · SMARTPHONES IN OPHTHALMOLOGY • External photography • Fundus imaging • AI – based screening for D.R. ... Data Storage &

Thank You

EyeTopo

Thank You