big data visualization and spatial computing in precision...

23
Alexandros Sigaras | @AlexSigaras Senior Research Associate in Computational Biomedicine Weill Cornell Medicine Biomedical Big Data Summer Bootcamp 2019 Weill Cornell Medicine 06.19.2019 Big Data Visualization and Spatial Computing in Precision Medicine

Upload: others

Post on 03-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Alexandros Sigaras | @AlexSigarasSenior Research Associate in Computational BiomedicineWeill Cornell Medicine

Biomedical Big Data Summer Bootcamp 2019

Weill Cornell Medicine06.19.2019

Big Data Visualization and Spatial Computing in Precision Medicine

Page 2: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

PrecisionMedicine

“The right treatment, for the right person,

at the right time”

Page 3: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

The New style of tailored treatment

http://meyercancer.weill.cornell.edu/news/2015-01-22/new-style-tailored-treatment

Irene Price | 76y Female

• 2009 | Diagnosed with Bladder Cancer; initially followed traditional treatment showing signs of success

• Relapse | High-grade urothelial carcinoma in bladder and several lymph nodes

• Cystectomy (Bladder removal), sample sent for Genetic Analysis (WES)

• Underwent Radiation Therapy, Genetic Analysis Results showed HER2 Amplification (mutation common in breast cancer)

• Relapse | Signs of metastasis to the liver• Chemotherapy targeted treatment | 8 cycles with

Taxol and Herceptin• Disease free since Nov 2014

Medical History

Page 4: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Precision MedicineImpact

Dr. Kevin Holcomb and Ronda Kotelchuck

https://healthmatters.nyp.org/amazing-things-ronda-kotelchuck/

“I love Dr. Holcomb… He’s very reasonable, and he respects the patient. We really do make decisions jointly.”

Ronda Kotelchuck

Page 5: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Artificial Intelligencein Healthcare

Page 6: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

PMKB

Huang et al “The cancer precision medicine knowledge base for structured clinical-grade mutations and interpretations” JAMIA 2017

Page 7: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

CNN Smoothie

P Khosravi et al. “Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images” EBioMedicine 2018

Page 8: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

CNN Smoothie

P Khosravi et al. “Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images” EBioMedicine 2018

Page 9: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Spatial Computing in Medicine

Page 10: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Reality-VirtualityContinuum

Milgram, Paul, et al. "Augmented reality: A class of displays on the reality-virtualitycontinuum." Telemanipulator and telepresence technologies. International Society for Optics and Photonics, 1995.

PhysicalReality (PR)

VirtualReality (VR)

AugmentedReality (AR)

AugmentedVirtuality (AV)

Mixed Reality (MR)

Page 11: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

AugmentedReality

Page 12: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://youtu.be/Fly4U9eFRY

VirtualReality

Page 13: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

MixedReality

Page 14: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Visualizing Cancer Drug Networks

Gayvert, Kaitlyn M., et al. "A computational drug repositioning approach for targeting oncogenic transcription factors." Cell reports 15.11 (2016): 2348-2356.

Page 15: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://youtu.be/Yu3Vxy6lQwg

EIPM Mixed Reality Apps

Page 16: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Tumor BoardUsing Mixed Reality across the world

Page 17: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big
Page 18: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://youtu.be/O99CMi2ahD0

EIPM Tumor Boardusing Mixed Reality

Page 19: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://twitter.com/AlexSigaras/status/897242543276138496

Realtime collaborationin Mixed Reality

Page 20: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Realtime collaborationin Mixed Reality

Page 21: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://twitter.com/AlexSigaras/status/835210917746966529

Physicsin Mixed Reality

Page 22: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

https://youtu.be/ZhAzqaV-lQk

Page 23: Big Data Visualization and Spatial Computing in Precision Medicinebigdata.citytech.cuny.edu/wp-content/uploads/2019/07/... · 2019-07-05 · Weill Cornell Medicine Biomedical Big

Caryl and Israel Englander Institute for Precision Medicine

23

eipm.weill.cornell.edu