semantic tagging on historical maps

15
Semantic Tagging on Historical Maps Bernhard Haslhofer and Werner Robitza (University of Vienna) Carl Lagoze (University of Michigan) François Guimbretière (Cornell University) ACM Web Science 2013, Paris

Upload: bernhard-haslhofer

Post on 11-May-2015

264 views

Category:

Internet


5 download

DESCRIPTION

ACM WebSci'13 Talk

TRANSCRIPT

Page 1: Semantic Tagging on Historical Maps

Semantic Tagging on Historical Maps

Bernhard Haslhofer and Werner Robitza (University of Vienna)Carl Lagoze (University of Michigan)François Guimbretière (Cornell University)

ACM Web Science 2013, Paris

Page 2: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Tagging

2

flickr:wlappe/2902517299/

Paris

Paris

http://youtu.be/hWo-43ObCP8

Page 3: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Tagging - Problems

3

Paris

Paris

Page 4: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Label- vs. Semantic Tagging

utr

Label-based tagging[Marlow et al. 2006] K

u

rx

t

ryabout

Semantic tagging

tag: String tag: URI Reference

4

Page 5: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013 5

http://maphub.github.com

Page 6: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Semantic Tagging in Maphub

There is a DBpedia/Wikipedia URI behind each visual tag

http://dbpedia.org/resource/Mediterranean_sea

6

Page 7: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Semantic Tagging in Maphub

7

K

urx

t1

ryrz

+

t2

-

Page 8: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Research Questions

• What are the effects of semantic tagging on

• tag production

• types and categories of tags added

• user task load

... compared to other tagging techniques.

8

Page 9: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Methodology

• In-lab experiment, 24 students, 2 maps

• Each creating 4 annotations under varying conditions

• Label-based tagging (LT)

• Suggestive tagging (ST)

• Semantic tagging (SMT)

• Semantic tagging with context display (SMT-CTX)

• Pre- and post-test surveys (NASA TLX)

9

Page 10: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

• No difference in accepted tags between SEM/SEM-CTX and LT

• Less rejected tags under SEM/SEM-CTX than under ST

Results / Effect on Tag Production

0

2

4

6

LT ST SMT SMT−CTXCondition

Mea

n N

umbe

r of T

ags

User Feedbackacceptedrejected

10

Page 11: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

• Tag types : no significant difference among conditions

• 48% factual

• 52% personal

• Tag categories: no significant difference among conditions

• 54% locations

• 7% persons or groups

• 39% other

Results / Effect on Tag Types and Categories

11

Page 12: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Results / Effect on User Task Load

Mental Eff.

Physical Eff.

Temporal Eff.

Success

Effort

Frustr.

0 2 4Average TLX Score

conditionLTSTSMTSMT−CTX

• Additional effort caused by SMT and SMT-CTX had no effect on user task load

• Participants found SMT-CTX most useful and intuitive

12

Page 13: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Results / Summary

• Semantic tagging (as implemented in Maphub) provides unambiguous relationships to well-defined and linked Web resources and does NOT affect

• tag production

• types and categories of tags

• user task load

13

Page 14: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Other Observations

“I am doing this [annotation] because I am from the Philadelphia area”

14

Page 15: Semantic Tagging on Historical Maps

ACM Web Science 2013, May 2013

Thanks !@bhaslhofer

http://slideshare.net/bhaslhofer

http://bernhardhaslhofer.info

http://maphub.github.io

15