cross- modal object recognition is viewpoint independent

16
SE 367: INTRODUCTION TO COGNITIVE SCIENCE SUBMITTED BY:- HEMANGINI PARMAR Y8214 Cross- Modal Object Recognition is Viewpoint Independent Final Project Presentation

Upload: ori-moss

Post on 04-Jan-2016

26 views

Category:

Documents


0 download

DESCRIPTION

Cross- Modal Object Recognition is Viewpoint Independent. Final Project Presentation. SE 367: Introduction to cognitive science Submitted by:- Hemangini parmar y8214. Objects. Dimensions~ (3-5)cm x 2cm x 2cm Lego bricks used Mirror images avoided - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Cross- Modal Object Recognition is Viewpoint Independent

S E 3 6 7 : I N T R O D U C T I O N T O C O G N I T I V E S C I E N C E

S U B M I TT E D BY: -

H E M A N G I N I PA R M A RY 8 2 1 4

Cross- Modal Object Recognition is Viewpoint Independent

Final Project Presentation

Page 2: Cross- Modal Object Recognition is Viewpoint Independent

Objects

Dimensions~ (3-5)cm x 2cm x 2cmLego bricks usedMirror images avoidedVery similar objects to prevent distinctive

cues

Page 3: Cross- Modal Object Recognition is Viewpoint Independent

Objects

Page 4: Cross- Modal Object Recognition is Viewpoint Independent

Objects

Page 5: Cross- Modal Object Recognition is Viewpoint Independent

Objects

Page 6: Cross- Modal Object Recognition is Viewpoint Independent

Objects

Page 7: Cross- Modal Object Recognition is Viewpoint Independent

Experimental Setup

20 female participants: age group=19-21 years

Random sequence for [modality,rotation] per object to avoid any pattern formationwhere

modality={VV,VH,HV,HH}rotation={UR,X,Y,Z}

Visual mode= 15 secHaptic mode=30sec

Page 8: Cross- Modal Object Recognition is Viewpoint Independent

Haptic Setup

Page 9: Cross- Modal Object Recognition is Viewpoint Independent

Visual Setup

Page 10: Cross- Modal Object Recognition is Viewpoint Independent

Observation Accuracy

Page 11: Cross- Modal Object Recognition is Viewpoint Independent

OSIQ

Page 12: Cross- Modal Object Recognition is Viewpoint Independent

Correlation with Spatial scores

0.1

0.12

0.14

0.16

0.18 0.

20.

220.

240.

260.

280

0.5

1

1.5

2

Cross Modal-R

Cross Modal-R

0.1

0.12

0.14

0.16

0.18 0.

20.

220.

240.

260.

280

0.20.40.60.8

11.2

Cross Modal-UR

Cross Modal-UR

0.1

0.12

0.14

0.16

0.18 0.

20.

220.

240.

260.

280

0.5

1

1.5

2

2.5

3

Within Modal-R

Within Modal-R

0.1

0.12

0.14

0.16

0.18 0.

20.

220.

240.

260.

280

0.20.40.60.8

11.2

Within Modal-UR

Within Modal-UR

Page 13: Cross- Modal Object Recognition is Viewpoint Independent

Correlation with Object Imagery Scores

0.1 0.15 0.2 0.25 0.30

0.20.40.60.8

11.21.41.6

Cross Modal-R

Cross Modal-R

0.1 0.15 0.2 0.25 0.30

0.2

0.4

0.6

0.8

1

1.2

Cross Modal-UR

Cross Modal-UR

0.1 0.15 0.2 0.25 0.30

0.5

1

1.5

2

2.5

3

Within Modal-R

Within Modal-R

0.1 0.15 0.2 0.25 0.30

0.2

0.4

0.6

0.8

1

1.2

Within Modal-UR

Within Modal-UR

Page 14: Cross- Modal Object Recognition is Viewpoint Independent

Conclusion

The hypothesis that cross-modal recognition is viewpoint independent is validated

The hypothesis that a higher level representation is involved in cross-modal object recognition is still unclear.

Page 15: Cross- Modal Object Recognition is Viewpoint Independent

References

 Lacey S, Peters A, Sathian K (2007) Cross-Modal Object Recognition Is Viewpoint-Independent. PLoS ONE 2(9): e890. doi:10.1371/journal.pone.0000890

Olessia Blajenkova, Maria Kozhevnikov and Michaela Motes (2006) Object-Spatial Imagery: A New Self-Report Imagery Questionnaire, Appl. Cognit. Psychol. 20: 239–263 (2006)

Page 16: Cross- Modal Object Recognition is Viewpoint Independent