reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •motivation...

33
SPIE PW 2018 [email protected] www.bu.edu/OCN 1/32 Reconstruction in wide-field interferometric microscopy for imaging weakly scattering biological nanoparticles with super-resolution M. Selim Ünlü Electrical Engineering, Physics, Biomedical Engineering Graduate Medical Sciences BUNano Photonics Center O. Avci, C. Yurdakul, D. Sevenler, F. Ekiz-Kanik, Lei Tian

Upload: others

Post on 01-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 1/32

Reconstruction in wide-field interferometric microscopy for imaging weakly scattering biological nanoparticles with super-resolution

M. Selim Ünlü

Electrical Engineering,

Physics,

Biomedical Engineering

Graduate Medical Sciences

BUNano

Photonics Center

O. Avci, C. Yurdakul, D. Sevenler, F. Ekiz-Kanik, Lei Tian

Page 2: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 2/32

Outline

• Motivation – Biological Nanoparticles everywhere

• Problem definition – contrast and size

• Detection vs. visualization

• Interferometric Reflectance Imaging Sensor

• Biological Nanoparticle Detection and Sizing

• Pupil function engineering

• Resolution improvement by oblique illumination and reconstruction

• Towards 100nm in label-free visible light microscopy

• Conclusions and Future

Page 3: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 3/32

Motivation - Nanoparticles

(Adapted from wichlab.com/research)

Polymer-based Semiconductor-based Metallic-based

Artificial nanoparticles

Natural nanoparticles

EV and Exosomes

Artificial nanoparticles

• Optically & physically engineered

• Used as labels or vehicles in diagnostics, therapeutic applications

• Gold, polystyrene NPs, QDs

Natural nanoparticles

• Low-index, complex-shaped

• Hard to detect without labels

• Virus – infectious diseases and cancer

• Exosome – secreted from cancer cells

ADVANCED WIDE-FIELD INTERFEROMETRIC MICROSCOPY FOR NANOPARTICLE SENSING AND CHARACTERIZATION

Page 4: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 4/32

Extra cellular vesicles, exosomes, and viruses

Example cryo-EM images of infectious extracellular vesicle (Bullitt Lab – BU MED)

Viruses are the most abundant species on earth. ~1032 phages in the biosphere ~107 viruses on average in a mL of seawater

SEM image of Ebola virion

Page 5: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 5/32

Optical microscopy can see small – but …

micro.magnet.fsu.edu/primer/

Page 6: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 6/32

Biological Nanoparticle Detection Challenges – size and dielectric contrast

Einc Esca

mp

mpR

24 3

0

Size contrast

Ziegler

Signal ~ R6

Page 7: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 7/32

Single nanoparticle detection / visualization • High-resolution imaging systems provide visualization of

nanoparticles – detailed structural information • Low-throughput, expensive and laborious

• Digital detection systems provide sensing of nanoparticles without visualization – limited or no structural information

• High-throughput, often inexpensive and straightforward

Conventional Microscope

Often undetected

Digital detection

Detected but not resolved

Sample

Biological particle

High-resolution

Detected & resolved

ADVANCED WIDE-FIELD INTERFEROMETRIC MICROSCOPY FOR NANOPARTICLE SENSING AND CHARACTERIZATION

Page 8: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 8/32

Current State of the Art Technology

Zeiss Libra 200

clf.stfc.ac.uk

Electron microscopy Fluorescence microscopy (STED/PALM)

• Laborious • Sample prep • Expensive • Not label-free • Low-throughput

• Great resolution

Page 9: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 9/32

Outline – IRIS

• Motivation – Biological Nanoparticles everywhere

• Problem definition – contrast and size

• Detection vs. visualization

• Interferometric Reflectance Imaging Sensor

• Biological Nanoparticle Detection and Sizing

• Pupil function engineering

• Resolution improvement by oblique illumination and reconstruction

• Conclusions and Future

Page 10: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 10/32

Interferometric Reflectance Imaging Sensor (IRIS) a high throughput biosensing platform

soap film Oxide coated Si

Ünlü et al, ”STRUCTURED SUBSTRATES FOR OPTICAL SURFACE PROFILING,’ US Patent No: 9599611, 2017

pg/mm2 sensitivity 1,000s of spots

Protein microarray chips with 100s to 1,000s of probe spots

@ $0.1/cm2

Page 11: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 11/32

Eref

Esca

sin2I22

det scarefscaref EEEE

mp

mpR

24 3

0

Size Material

SiO2

Si

Phase Term

Page 12: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 12/32

Rahul Vedula(MD) and George Daaboul, PhD ‘13

Single Particle Detection Simple

Page 13: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 13/32

Exosome detection

Anti-CD81 capture probe image acquired before and after incubation with purified HEK293 cells derived exosomes.

Page 14: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 14/32

Verification by SEM and AFM – down to r=30nm dry

Page 15: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 15/32

Various viruses

Page 16: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 16/32

In-liquid detection to simplify the assay

16

Page 17: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 17/32

Passive Cartridge - Simple Workflow

1. Remove cartridge from package just prior to use 2. 100 uL of sample is pipetted into the bottom of the reservoir (*care

needs to be taken not to introduce bubbles) 3. Luer cap (sealed with adhesive strip) is screwed down finger tight 4. When liquid reaches the pad, the luer cap is vented (adhesive strip

removed) 5. Cartridge is placed in the instrument to begin acquiring data

‘15

‘17

Page 18: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 18/32

Page 19: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 19/32

Outline – Going Beyond Detection and Sizing

• Motivation – Biological Nanoparticles everywhere

• Problem definition – contrast and size

• Detection vs. visualization

• Interferometric Reflectance Imaging Sensor

• Biological Nanoparticle Detection and Sizing

• Pupil function engineering

• Resolution improvement by oblique illumination and reconstruction

• Towards 100nm in label-free visible light microscopy

• Conclusions and Future

Page 20: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 20/32

Reconstruction in Interference Microscopy

?

observation

imaging system

in out

object

observation noise object system response

convolution matrix

(J. Trueb*, O. Avci* et al., IEEE JSTQE, 2016)

ADVANCED WIDE-FIELD INTERFEROMETRIC MICROSCOPY FOR NANOPARTICLE SENSING AND CHARACTERIZATION

Page 21: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 21/32

Interferometric fringes – defocus profile

Changing the focus position changes

the path length to the detector

differently for reference reflection and

scattered light

‘17

‘17

D. Sevenler et al, "Quantitative interferometric reflectance imaging for the detection and measurement of biological nanoparticles," Biomedical Optics Express, 2017 O. Avci, et al., "Physical Modeling of Interference Enhanced Imaging and Characterization of Single Nanoparticles," Optics Express, 2016 O. Avci, et al. "Pupil function engineering for enhanced nanoparticle visibility in wide-field interferometric microscopy," Optica2017

Page 22: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 22/32

‘17

Page 23: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 23/32

‘17

Overall of 10X enhancement

Page 24: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 24/32

Collection Path – Apodization and Reference Attenuation

Page 25: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 25/32

Registered silica particles defocus curve ~4X enhancement (2.2% → 8%)

Page 26: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 26/32

Reconstruction – first with defocus

• Defocus based reconstruction

SEM

1 micron

300 nm

50

0 n

m

Top

80 nm

Si

SiO2 50 nm

Side

(conventional) (reconstruction)

50x/0.8NA 525nm

• Tikhonov regularization: Least-squares cost function with quadratic side-constraint

Page 27: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 27/32

NATURE PHOTONICS | VOL 8 | MAY 2014 |

Reconstruction – Structured Illumination (?)

Page 28: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 28/32

Page 29: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 29/32

10/2/2018

• Enhancing low-index nanoparticle resolution via reconstruction schemes Asymmetric illumination based reconstruction for super resolution (with Lei Tian)

ADVANCED OPTICAL SCHEMES IN WIDE-FIELD INTERFEROMETRIC MICROSCOPY FOR ENHANCED NANOPARTICLE SENSING AND CHARACTERIZATION

Right Bottom Left Top

Fourier transforms of the transfer functions (H) for each asymmetric illumination configuration

Super-resolution in wide-field interferometric microscopy

Page 30: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 30/32

SEM

raw reconstruction

50x/0.8NA 525nm

Experimental Results

300 nm

Sketch

10/2/2018

SEM

100x/0.9NA 525nm

50x/0.8NA 525nm

Si

oxide

Sample – E-beam fabricated

80 nm

Page 31: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 31/32

150 nm separation, 0.9 NA, 𝝺=420nm

Page 32: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 32/32

FWHM ~ 130nm < (𝝺 / 3)

Page 33: Reconstruction in wide-field interferometric microscopy for … · 2018. 10. 12. · •Motivation – Biological Nanoparticles everywhere •Problem definition – contrast and size

SPIE PW 2018 [email protected] www.bu.edu/OCN 33/32

CONCLUSIONS & FUTURE

• Optical interference is a very powerful sensing technique.

• Multi-disciplinary innovation

• Single biological nanoparticle detection / counting / size and shape discrimination / visualization

• Goals: Down to r=20nm Biological nanoparticle detection in liquid

• Lateral resolution of ~100nm without labeling