![Page 1: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/1.jpg)
Text Categorization and Images
![Page 2: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/2.jpg)
Text Categorization
• Text categorization (TC) refers to the automatic labeling of documents, using natural language text contained in or associated with each document, into one or more pre-defined categories.
• TC techniques can be applied to image captions to label the corresponding images.
![Page 3: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/3.jpg)
Outdoor Indoor
![Page 4: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/4.jpg)
Clues for Indoor/Outdoor:Text (as opposed to Vision)
Denver Summit of Eight leaders begin their first official meeting in the Denver Public Library, June 21.
The two engines of an Amtrak passenger train lie in the mud at the edge a marsh after the train, bound for Boston from Washington, derailed on the bank of the Hackensack River, just after crossing a bridge.
![Page 5: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/5.jpg)
NewsBlaster Categories
Entertainment Science/Technology Sports
U.S. News World News Finance
![Page 6: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/6.jpg)
Events Categories
Politics Struggle
Disaster Crime Other
![Page 7: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/7.jpg)
Subcategories for Disaster Images
Politics Struggle
Disaster Crime Other
Category F1
Politics 89%
Struggle 88%
Disaster 97%
Crime 90%
Other 59%
Affected People OtherWreckageWorkers Responding
![Page 8: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/8.jpg)
Disaster Image Categories
Affected People
OtherWreckage
Workers Responding
![Page 9: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/9.jpg)
Words are Ambiguous:Workers Responding vs. Affected People
Philippine rescuers carry a fire victim March 19 who perished in a blaze at a Manila disco.
Hypothetical alternative caption: A fire victim who perished in a blaze at a Manila disco is carried by Philippine rescuers March 19.
Workers Responding Affected People
![Page 10: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/10.jpg)
Collect Labels to Train Systems
![Page 11: Text Categorization and Images. Text Categorization Text categorization (TC) refers to the automatic labeling of documents, using natural language text](https://reader036.vdocuments.net/reader036/viewer/2022082712/56649f1e5503460f94c35b97/html5/thumbnails/11.jpg)
Contributions of My Research
• Applied text categorization (TC) techniques to images using associated text.
• Created a corpus, hoping to make it public.
• Introduced two novel TC approaches.
• Integrated NLP with traditional approaches.
• Explored combination of approaches.
• Combined text and image features.