![Page 1: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/1.jpg)
NLP research trend in the last five years and VA NLP research
accomplishments
Wendy Chapman
![Page 2: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/2.jpg)
Health Services Researcher
Salomeh Keyhani
San Francisco VA
Is surgery or medication better for stroke on patients with
carotid stenosis?
2008 – unable to do the research
![Page 3: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/3.jpg)
How do I find reports describing carotid studies?
MRI, CT, Ultrasound, Angiograms of the NECK • Not all describe carotid study
![Page 4: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/4.jpg)
How do I determine if a patient had significant stenosis in right internal carotid artery?
FINDINGS: There was extensive plaque seen in the proximal right internal carotid artery. Only very mild atherosclerotic plaque was seen in the proximal left ICA. No stenosis in the left external carotid. IMPRESSION: 1). Very severe diameter reduction 80-99% right proximal ICA. 2). Less than 20% stenosis in the left ICA.
![Page 5: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/5.jpg)
How do I determine if a patient had significant stenosis in right internal carotid artery?
FINDINGS: There was extensive plaque seen in the proximal right internal carotid artery. Only very mild atherosclerotic plaque was seen in the proximal left ICA. No stenosis in the left external carotid. IMPRESSION: 1). Very severe diameter reduction 80-99% right proximal ICA. 2). Less than 20% stenosis in the left ICA.
Severity
![Page 6: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/6.jpg)
How do I determine if a patient had significant stenosis in right internal carotid artery?
FINDINGS: There was extensive plaque seen in the proximal right internal carotid artery. Only very mild atherosclerotic plaque was seen in the proximal left ICA. No stenosis in the left external carotid. IMPRESSION: 1). Very severe diameter reduction 80-99% right proximal ICA. 2). Less than 20% stenosis in the left ICA.
Severity Negation
![Page 7: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/7.jpg)
How do I determine if a patient had significant stenosis in right internal carotid artery?
FINDINGS: There was extensive plaque seen in the proximal right internal carotid artery. Only very mild atherosclerotic plaque was seen in the proximal left ICA. No stenosis in the left external carotid. IMPRESSION: 1). Very severe diameter reduction 80-99% right proximal ICA. 2). Less than 20% stenosis in the left ICA.
Severity Negation Location
![Page 8: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/8.jpg)
I need someone with NLP expertise!
• Where do I look?
• How long will it take until they can get access to VA data?
• Do they understand the peculiarities of VA reports?
• How will they create train and test data?
• Can we install their NLP tool in the VA firewall?
![Page 9: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/9.jpg)
NLP with the VA
2008 • Where do I look?
• How long will it take until they can get access to VA data?
• Do they understand the peculiarities of VA reports?
• How will they create train and test data?
• Can we install their NLP tool in the VA firewall?
Now
• NLP expertise/partners
• Annotation processes
• NLP tools
![Page 10: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/10.jpg)
Health Services Researcher
Salomeh Keyhani
San Francisco VA
Is surgery or medication better for stroke on patients with
carotid stenosis?
2015 – leveraging NLP to make it possible
![Page 11: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/11.jpg)
State of NLP in the VA
1. NLP has shown tremendous impact within the VA
2. NLP research within the VA contributes to the science of clinical NLP
3. Synergy within and outside of VA NLP community
![Page 12: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/12.jpg)
Impact
NLP Expertise Supporting Research
NLP Development & Application
New Variables in CDW
![Page 13: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/13.jpg)
Developed and recruited
NLP Expertise in the VA
Cindy Brandt
![Page 14: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/14.jpg)
26-44% of VA publications use NLP
0
20
40
60
80
100
120
140
1 2 3 4 5 6 7 8 9
Total
NLP
![Page 15: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/15.jpg)
VA Grants
Cognitive Support
Informatics for Nurse Medication
Stewardship
Charlene Weir Salt Lake City
Supporting Health Services Research
Automated Surveillance for
Patients with Cirrhosis
Samuel Ho San Diego
Michael Matheny
Nashville
Cognitive Support Informatics for Antimicrobial Stewardship
Peter Glassman
Los Angeles
![Page 16: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/16.jpg)
NIH grants
NHLBI
An Evaluation of Novel Domains
for Predicting 30-day Admission
Salomeh Keyhani UCSF
Supporting Health Services Research
NIAMS Determinants of Achieving Target Serum Urate in
Gout & Safety of Gout Treatments
Jasvindar Singh U of Alabama
NIGMS Clinical
Personalized Pragmatic
Predictions of Outcomes
Leslie Lenert
MUSC
![Page 17: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/17.jpg)
NLP
Information Retrieval
Information Extraction
Annotation
Evaluation
Vocabulary/Ontology Building
Machine Learning
Chart Review workflows
Knowledge Author, IE-Viz, Nora
Leo, Moonshine, V3NLP, Sophia, cTAKES, metaMap, YTEX, HiTEX, RapTAT, pyConText
eHOST, VTT, Knowtator, UIMA, Chart Review
v3NLP, Evaluation Workbench, eHOST
Voogo
Weka, R, Mallet, Super Learner, ARC, Leo, QOTE, REDex
Annotation Admin, RapTat
NLP Development & Application
![Page 18: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/18.jpg)
New Variables in CDW
Pilot Evaluate Improve Enterprise
Age Dx Labs
![Page 19: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/19.jpg)
New Variables in CDW
Homeless
Living alone
Functional status
Substance abuse
Social support Delirium
Pneumonia
Carotid stenosis
Pain scale
Adenoma
Gender
Pilot Evaluate
Symptoms
CAUTI
MRSA
Sexual trauma
![Page 20: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/20.jpg)
State of NLP in the VA
1. NLP has shown tremendous impact within the VA
2. NLP research within the VA contributes to the science of clinical NLP
3. Synergy within and outside of VA NLP community
![Page 21: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/21.jpg)
Scientific Contribution: NLP Publications from VA Investigators
![Page 22: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/22.jpg)
Number of VA publications with NLP has increased
0
10
20
30
40
50
60
2007 2008 2009 2010 2011 2012 2013 2014 2015
Number of VA NLP Publications
![Page 23: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/23.jpg)
Scientific Contributions
Algorithms Knowledge
Representation
Resources Informatics &
Health Services Research
![Page 24: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/24.jpg)
• Active learning
• De-identification
• Modifier detection
• Named entity detection
• Symptom identification
• Synonym identification
• Figure detection
• Template identification
• Uncertainty detection
• Translation to consumer language
• Temporal expression identification
• Scale up and scale out
Algorithms
![Page 25: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/25.jpg)
Knowledge Representation
Common Model
• Map output of NLP modules to each other
• Enable interoperability
![Page 26: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/26.jpg)
Knowledge Representation
Schema & Modifier
Ontologies
• Represent entities and modifiers
• Provide baseline lexicon
• Support knowledge sharing
Disease: colon cancer Experiencer: family Negation: no Historical: yes
“Patient denies a family
history of colon cancer”
![Page 27: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/27.jpg)
Shared Resources
Annotation Tools
eHOST
RapTat
Chart Review
![Page 28: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/28.jpg)
Shared Resources
Information Extraction Tools
yTex
v3NLP
Moonstone
Rad-Ex
Sophia
Leo
ConText RapTat
![Page 29: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/29.jpg)
Shared Resources
Knowledge Building Tools
Knowledge Author
Nora
![Page 30: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/30.jpg)
Shared Resources
Machine Learning Tools
ARC
QOTE
REDex
![Page 31: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/31.jpg)
• Surveillance of Acute Kidney Injury following Cardiac Catheterization
• Automated Surveillance for Patients with Cirrhosis
• Actionable Knowledge to Guide Antimicrobial Stewardship
• Evaluation of Multistage Antimicrobial Treatment Strategies in Pneumonia
• Preventing MRSA Infections: a virtual comparative effectiveness model
• Comparative effectiveness for stroke treatment
Informatics & Health Services Research
![Page 32: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/32.jpg)
State of NLP in the VA
1. NLP has shown tremendous impact within the VA
2. NLP research within the VA contributes to the science of clinical NLP
3. Synergy within and outside of VA NLP community
![Page 33: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/33.jpg)
Synergistic Relationship
Clinical NLP Community
VA NLP Community
![Page 34: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/34.jpg)
Orbit Registry
Clinical NLP Community
NLP Toolfinder
ShaRE & i2b2 annotations
Training Data
NLP tools
VA tools
NLP development
NLP Ecosystem
![Page 35: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/35.jpg)
Schema & annotations
I2b2 challenge
Common model
Integrate modules
Shared meetings
Collaboration
NLP ecosystem
Support develop
VA NLP Community
![Page 36: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/36.jpg)
Health Services Researcher
Salomeh Keyhani
San Francisco VA
Is surgery or medication better for stroke on patients with
carotid stenosis?
2015 – leveraging NLP to make it possible
![Page 37: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/37.jpg)
NLP Within the VA
• Can ask questions they couldn’t ask before
Health Services
Researchers
![Page 38: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/38.jpg)
NLP Within the VA
• Can ask questions they couldn’t ask before
Health Services
Researchers
• Can provide more comprehensive and intuitive cognitive support
Informatics Researchers
![Page 39: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/39.jpg)
NLP Within the VA
• Can ask questions they couldn’t ask before
Health Services
Researchers
• Can provide more comprehensive and intuitive cognitive support
Informatics Researchers
• Can better participate in shared decision making Patients
![Page 40: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/40.jpg)
Steps on a path to cognitive computing
What is your long-term vision?
![Page 41: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/41.jpg)
What We Are Missing
• Question answering
• Text summarization
• Visualization of data
• Speech recognition and synthesis
Recruit & Partner
Collaborative Funding
Infrastructure
![Page 42: NLP research trend in the last five years and VA NLP research](https://reader031.vdocuments.net/reader031/viewer/2022021923/586b68da1a28ab803b8bc621/html5/thumbnails/42.jpg)
Thank you!