semantic tagging on historical maps

Semantic Tagging on Historical Maps

Bernhard Haslhofer and Werner Robitza (University of Vienna)Carl Lagoze (University of Michigan)François Guimbretière (Cornell University)

ACM Web Science 2013, Paris

ACM Web Science 2013, May 2013

Tagging

2

flickr:wlappe/2902517299/

Paris

Paris

http://youtu.be/hWo-43ObCP8

ACM Web Science 2013, May 2013

Tagging - Problems

3

Paris

Paris

ACM Web Science 2013, May 2013

Label- vs. Semantic Tagging

utr

Label-based tagging[Marlow et al. 2006] K

u

rx

t

ryabout

Semantic tagging

tag: String tag: URI Reference

4

ACM Web Science 2013, May 2013 5

http://maphub.github.com

ACM Web Science 2013, May 2013

Semantic Tagging in Maphub

There is a DBpedia/Wikipedia URI behind each visual tag

http://dbpedia.org/resource/Mediterranean_sea

6

ACM Web Science 2013, May 2013

Semantic Tagging in Maphub

7

K

urx

t1

ryrz

+

t2

-

ACM Web Science 2013, May 2013

Research Questions

• What are the effects of semantic tagging on

• tag production

• types and categories of tags added

• user task load

... compared to other tagging techniques.

8

ACM Web Science 2013, May 2013

Methodology

• In-lab experiment, 24 students, 2 maps

• Each creating 4 annotations under varying conditions

• Label-based tagging (LT)

• Suggestive tagging (ST)

• Semantic tagging (SMT)

• Semantic tagging with context display (SMT-CTX)

• Pre- and post-test surveys (NASA TLX)

9

ACM Web Science 2013, May 2013

• No difference in accepted tags between SEM/SEM-CTX and LT

• Less rejected tags under SEM/SEM-CTX than under ST

Results / Effect on Tag Production

0

2

4

6

LT ST SMT SMT−CTXCondition

Mea

n N

umbe

r of T

ags

User Feedbackacceptedrejected

10

ACM Web Science 2013, May 2013

• Tag types : no significant difference among conditions

• 48% factual

• 52% personal

• Tag categories: no significant difference among conditions

• 54% locations

• 7% persons or groups

• 39% other

Results / Effect on Tag Types and Categories

11

ACM Web Science 2013, May 2013

Results / Effect on User Task Load

Mental Eff.

Physical Eff.

Temporal Eff.

Success

Effort

Frustr.

0 2 4Average TLX Score

conditionLTSTSMTSMT−CTX

• Additional effort caused by SMT and SMT-CTX had no effect on user task load

• Participants found SMT-CTX most useful and intuitive

12

ACM Web Science 2013, May 2013

Results / Summary

• Semantic tagging (as implemented in Maphub) provides unambiguous relationships to well-defined and linked Web resources and does NOT affect

• tag production

• types and categories of tags

• user task load

13

ACM Web Science 2013, May 2013

Other Observations

“I am doing this [annotation] because I am from the Philadelphia area”

14

ACM Web Science 2013, May 2013

Thanks !@bhaslhofer

http://slideshare.net/bhaslhofer

http://bernhardhaslhofer.info

http://maphub.github.io

15