[email protected] medkat medical knowledge analysis tool december 2009

[email protected]

MedKATMedical Knowledge Analysis Tool

December 2009

mailto:[email protected]



Overview

✤ MedKAT and MedKAT/p✤ Developed at IBM, donated to OHNLP with Apache license V2.0✤ Goal:

✤ Identification of concepts and their attributes based on a standard or proprietary terminology/ontology

✤ “/p” adaptation to pathology reports – relation extraction✤ UIMA-based, Modular, Generic, Expandable✤ Terminology agnostic: able to plug in any terminology✤ Easy adaptation to specific corpus and conventions✤ Integration into institutional system

✤ Ongoing commitment to Research and Development

3

Core Components

✤ Document structure

✤ Syntactic tools (tokenization .. shallow parsing)

✤ Negation

✤ Concept identification

✤ Relationship extraction

4

Core Components



✤ Negation



Document Structure

✤ Plain text or XML (e.g., CDA)

✤ Processes specific document section types (e.g., diagnosis)

✤ Detection of enumerated subsections (e.g., lists)

✤ Detection of formatting (e.g. bullets)

✤ Detection of relations between sections (e.g., coreference between corresponding lists appearing in different document sections)

✤ Making implicit conventions explicit (e.g. meaning of title)

Document Structure Annotators

7

Document Structure

16

Multiple document sections

8

Document Structure

17

Corresponding document subsections

9

Document Structure

18

Need to know document structure to be able to

compute concept coreference during relation

extraction

10

Core Components



✤ Negation



Syntactic Structure Annotators

Tokenization

Basic building block for subsequent annotators. The text:

poorly-differentiated/undifferentiatedcould be tokenized as 1, 3, or 5 tokens:

Part of Speech Tagger

✤ OpenNLP POS tagger with standard models

✤ Domain adaptation:

✤ Entries from lexicon are pre-tagged

✤ Rule-based overwriting of tags for specific cases

14

Shallow Parser

32

Merging NP Types

The shallow parser defines three types of noun phrase:1. NP2. NPP3. NPList

Merging NP Types

The NPMerger module creates NPCombined annotations to cover all types of noun phrases.

17

Core Components



✤ Negation



Negation Annotators

Negation

✤ Keyword and syntactic analysis driven

✤ Set of keywords configurable via dictionary

✤ Type of syntactic phrase used to determine context is configurable

20

Core Components



✤ Negation



Concept Identification Annotators

Concept Identification

✤ Lexicon entries can be added, changed, deleted

✤ Lexicon entry attributes can be added, changed, deleted

✤ Search parameters can be modified

✤ Post processing filters

✤ Tokenization of text and lexicon should be the same

Lexicon Entries

✤ A sample lexicon entry. The variant elements define all of the synonyms that can be matched during lookup. Attributes associated with “token” element apply to all variants, but can be overridden within individual variants (e.g., the “POS” attribute in some of these variant entries).

<token canonical="colon, nos" CodeType="ICDO" CodeValue="C18.9" SemClass="Site" POS="NN"> <variant base="colon, nos" /> <variant base="colon" /> <variant base="colonic" POS="JJ" /> <variant base="colic" POS="JJ" /> <variant base="large intestine" /> <variant base="large bowel" /></token>

Concept Identification Configuration

✤ Configured to find all matched entries, not just longest match, even if overlapping

✤ Case-insensitive

✤ Token order independent matching performed, e.g.: A B C = C A B

✤ Subsequent filtering used to remove unnecessary over-generated results

Concept Filters

✤ Remove:

✤ any duplicates over a single span

✤ generic terms like “tumor” if part of a longer term

✤ terms that contain other terms that were previously marked, such as a modifier

26

Core Components



✤ Negation



Relationship Extraction Annotators

Relationship Extraction

✤ Find coreferences of both anatomical sites and histological diagnoses across document sections

✤ Discover relationships between named entities and build knowledge model:

✤ Tumors (primary, metastatic)

✤ Gross description

✤ Lymph nodes

Knowledge Model

✤ Benefits

✤ Summarization

✤ Comparison

✤ Change detection

✤ Temporal progression of disease

✤ Validation

✤ Manual annotation of pathology reports and clinical notes

The MedKAT/p Pipeline

MedKAT/p Annotator Pipeline

MedKAT/p Pipeline

✤ The full processing pipeline brings together all of the MedKAT components

✤ Used a manually annotated gold standard corpus of 302 documents: 201 documents for training, 101 for testing

✤ UIMA CAS can be output as database load file, XML, or other format using a UIMA CAS Consumer module

Concept Extraction Results

Training InstancesTraining Instances Test InstancesTest Instances F-ScoreF-Score

Anatomical SiteAnatomical Site 1,598 782 0.95

HistologyHistology 670 336 0.98

SizeSize 942 471 1.00

DateDate 145 88 1.00

GradeGrade 246 124 0.98

Model Extraction Results

Training InstancesTraining Instances Test InstancesTest Instances F-ScoreF-Score

Gross DescriptionGross Description 277 137 0.80

Lymph NodesLymph Nodes 117 59 0.81

Primary TumorPrimary Tumor 235 126 0.82

Metastatic TumorMetastatic Tumor 33 19 0.65

Summary

✤ MedKAT and MedKAT/p were developed at IBM, donated to OHNLP with Apache license V2.0

✤ Apache UIMA based solution for flexible, expandable system ✤ Concepts are identified, with their associated attributes, based on a standard

or proprietary terminology/ontology✤ The “/p” version has additional components for processing pathology reports

[email protected] medkat medical knowledge analysis tool december 2009

Documents