cs 294 final project paul ivanov - university of...

14
Interactive Eyetracking Visualization CS 294 Final Project Paul Ivanov UC Berkeley Vision Science Graduate Group Redwood Center for Theoretical Neuroscience http://redwood.berkeley.edu/ April 7, 2010

Upload: others

Post on 30-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Interactive Eyetracking VisualizationCS 294 Final Project

Paul Ivanov

UC BerkeleyVision Science Graduate Group

Redwood Center for Theoretical Neurosciencehttp://redwood.berkeley.edu/

April 7, 2010

Page 2: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Problem statement

If I want to show my colleagues some aspect of my data,I load up the data,

do the analysis,make a plot,and send them the PNG.

They look at it, and maybe see something that interests them.They write/talk to me about it and we iterate.I load up the data,

do the analysis,make a plot,and send them another PNG.

Rinse and repeat.Summary: I’m the problem

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 2 / 7

Page 3: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Problem statement

If I want to show my colleagues some aspect of my data,I load up the data,

do the analysis,make a plot,and send them the PNG.

They look at it, and maybe see something that interests them.They write/talk to me about it and we iterate.I load up the data,

do the analysis,make a plot,and send them another PNG.

Rinse and repeat.

Summary: I’m the problem

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 2 / 7

Page 4: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Problem statement

If I want to show my colleagues some aspect of my data,I load up the data,

do the analysis,make a plot,and send them the PNG.

They look at it, and maybe see something that interests them.They write/talk to me about it and we iterate.I load up the data,

do the analysis,make a plot,and send them another PNG.

Rinse and repeat.Summary: I’m the problem

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 2 / 7

Page 5: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Static Visualizations

An active area of research

Blignaut. Visual span and other parameters for thegeneration of heatmaps. Eye Tracking Research andAnalysis 2010

Goldberg and Helfman. Visual ScanpathRepresentation. Eye Tracking Research and Analysis2010

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 3 / 7

Page 6: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Dynamic stimulus example

If I want to show dynamic data to colleagues,here’s what I am limited to now. . .

“What we’ve got here, is a failure to communicate.”

–Cool Hand Luke

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 4 / 7

Page 7: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Dynamic stimulus example

If I want to show dynamic data to colleagues,here’s what I am limited to now. . .

“What we’ve got here, is a failure to communicate.”

–Cool Hand Luke

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 4 / 7

Page 8: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

New Tool

- Decouple analysis from data collector. Leave time in the equation.

- Stellmach COGAIN 2009 : By far the mostfrequent use of eyetracking in academiaconsists of static stimuli.

- Commercial products focus on generating static images: scanpaths,fixation heatmaps (Tobii,GazeTracker). Data tied to the software.- Ramloll et al. IV’04 - Good coverage of why such a tool is needed.Macromedia Flash implemention unavailable, dynamic stimuli limited toviewing a 3d object.- Goldberg and Helfman. ETRA’10 - Improved scanpaths - but still limitedto static stimuli. I will incorporate a time-windowed version.

ReferencesRamloll, Trepagnier, Sebrechts, Beedasy. Gaze Data Visualization Tools: Opportunities and Challenges. InformationVizualization 2004.Goldberg and Helfman. Visual Scanpath Representation. Eye Tracking Research and Analysis 2010Blignaut. Visual span and other parameters for the generation of heatmaps. Eye Tracking Research and Analysis 2010Stellmach et al. Trends and Techniques in Visual Gaze Analysis. Communication by Gaze Interaction 2009

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 5 / 7

Page 9: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

New Tool

- Decouple analysis from data collector. Leave time in the equation.

- Stellmach COGAIN 2009 : By far the mostfrequent use of eyetracking in academiaconsists of static stimuli.

- Commercial products focus on generating static images: scanpaths,fixation heatmaps (Tobii,GazeTracker). Data tied to the software.- Ramloll et al. IV’04 - Good coverage of why such a tool is needed.Macromedia Flash implemention unavailable, dynamic stimuli limited toviewing a 3d object.- Goldberg and Helfman. ETRA’10 - Improved scanpaths - but still limitedto static stimuli. I will incorporate a time-windowed version.

ReferencesRamloll, Trepagnier, Sebrechts, Beedasy. Gaze Data Visualization Tools: Opportunities and Challenges. InformationVizualization 2004.Goldberg and Helfman. Visual Scanpath Representation. Eye Tracking Research and Analysis 2010Blignaut. Visual span and other parameters for the generation of heatmaps. Eye Tracking Research and Analysis 2010Stellmach et al. Trends and Techniques in Visual Gaze Analysis. Communication by Gaze Interaction 2009

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 5 / 7

Page 10: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

New Tool

- Decouple analysis from data collector. Leave time in the equation.

- Stellmach COGAIN 2009 : By far the mostfrequent use of eyetracking in academiaconsists of static stimuli.

- Commercial products focus on generating static images: scanpaths,fixation heatmaps (Tobii,GazeTracker). Data tied to the software.- Ramloll et al. IV’04 - Good coverage of why such a tool is needed.Macromedia Flash implemention unavailable, dynamic stimuli limited toviewing a 3d object.- Goldberg and Helfman. ETRA’10 - Improved scanpaths - but still limitedto static stimuli. I will incorporate a time-windowed version.

ReferencesRamloll, Trepagnier, Sebrechts, Beedasy. Gaze Data Visualization Tools: Opportunities and Challenges. InformationVizualization 2004.Goldberg and Helfman. Visual Scanpath Representation. Eye Tracking Research and Analysis 2010Blignaut. Visual span and other parameters for the generation of heatmaps. Eye Tracking Research and Analysis 2010Stellmach et al. Trends and Techniques in Visual Gaze Analysis. Communication by Gaze Interaction 2009

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 5 / 7

Page 11: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Challenges and Milestones

Challenges

In-browser performance.JavaScript profiler - Venkman? Firebug?

Milestones

M1 - ProtoVis UI mockup (4/12)M2 - Data wrangling and basic implementation (4/21)M3 - Incoprorate the vis techniques and optimize (final)

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 6 / 7

Page 12: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

Challenges and Milestones

Challenges

In-browser performance.JavaScript profiler - Venkman? Firebug?

Milestones

M1 - ProtoVis UI mockup (4/12)M2 - Data wrangling and basic implementation (4/21)M3 - Incoprorate the vis techniques and optimize (final)

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 6 / 7

Page 13: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

You say you want a revolution. . .

Incremental. Close the gap between static tools which collapse acrosstime, and the ’beeswarm’ type visualization which only show the raw data.

Practical. Liberate the data for analysis by colleagues. Give researchers afree and effective tool.

Thanks. Feedback?

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 7 / 7

Page 14: CS 294 Final Project Paul Ivanov - University of …vis.berkeley.edu/courses/cs294-10-sp10/wiki/images/2/28/...Interactive Eyetracking Visualization - CS 294 Final Project Author Paul

You say you want a revolution. . .

Incremental. Close the gap between static tools which collapse acrosstime, and the ’beeswarm’ type visualization which only show the raw data.

Practical. Liberate the data for analysis by colleagues. Give researchers afree and effective tool.

Thanks. Feedback?

Paul Ivanov Interactive Eyetracking Visualization 2010-04-07 7 / 7