designing novel applications inspired by emerging media ... fileinventory of technologies...
TRANSCRIPT
UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE
Designing Novel Applications Inspired by Emerging Media TechnologiesFraming the Development of Novel Technologies
Hyowon Lee
CLARITY: Centre for Sensor Web Technologies Dublin City University
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
WallEmbedded Appliance
•
General Design Knowledge
:
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching •
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
::
Mobile Interaction Characteristics:•
Small screen
•
Awkward input mechanism
•
Distraction
•
Reduce required attention•
Quick return
•
Reduce browsing effort:
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
•
General Design Knowledge
:
Tabletop Interaction Characteristics:•
Horizontal
•
Multi-user, Collaborative setting
•
Task allocation (division)•
Workspace awareness
•
Coordination (eg. conflict)
Photo from Dialog Table, Walker Art Center http://dialogtable.com/
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
•
General Design Knowledge
:
•
Large widgets, large text•
Minimal, simple interaction
•
Multiple levels of attention:
“Lean-back Interaction”
•
Viewed 2-3m away
•
Use of remote control
TV Interaction Characteristics:
Photo from Tutorial, K. Chorianopoulos, EuroITV 2008
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
INTERACTION DESIGNDOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
PROBLEM SOLUTION
?
?
?
Interaction Platform-
specific Knowledge
Desktop/Web•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
Mobile
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
TableTop
InteractiveTV
Wall
•
General Design Knowledge
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
•
Design principles•
Usability guidelines/ heuristics
•
Designer’s skill/ experience
TableTop
•
General Design Knowledge
:
Interactive Wall Characteristics:•
Large
•
Public
•
Multi-user setting
•
Focal/peripheral interplay•
Coordination (conflict resolution)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
New practice
Imagined practice
•
General Design Knowledge
:
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
SIFT tool*
Museum Information
Blighe M, Sav S, Lee H
and O'Connor N. Mo Músaem Fíorúil: A Web-based Search and Information Service for Museum Visitors. ICIAR 2008 -
International Conference on Image Analysis and Recognition, Povoa de Varzim, Portugal, 25-27 June 2008.
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarity-
Web connectivity
Museum Information
Clip searching during TV watching
Lee H, Ferguson P, Gurrin C, Smeaton A.F, O'Connor N and Park H. Balancing the Power of Multimedia Information Retrieval and Usability in Designing Interactive TV.
uxTV 2008 -
International Conference on Designing Interactive User Experiences for TV and Video, Mountain View, CA, 22-24 October 2008.
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarityClip searching during TV watching
Collaborative media searching
Museum Information
Smeaton A.F, Lee H, Foley C and Mc Givney
S. Collaborative Video Searching on a Tabletop. Multimedia Systems Journal, Vol. 12, No. 4, 2006.
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Video indexing-
Content similarity
Collaborative media searching
Museum Information
Clip searching during TV watching
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
Clip searching during TV watching
In-Home Power Monitor
-
Power Sensors-
Device ID
Collaborative media searching
Museum Information
–
Always ON (day/night readability)–
Constant data display for passer-by
–
Simple finger-touch interaction–
Context information required
–
No ‘main menu’: useful information upfront, requiring no interaction
–
Rich data presented simple–
Real-time data in context (to history data, yesterday, average, neighbour, etc.)
In-Home Display: Characteristics
DOMAIN(on users, tasks, etc.)
Writing a document
Managing library
Air Traffic Control
Medical info searching
Inventory of TECHNOLOGIES (mainstream, robust/proven)
•
Computation•
Database•
Web•
3-D rendering•
Streaming:
PROBLEM SOLUTION
?
?
?
NEW TECHNOLOGIES
•
Multimedia•
Semantic Web•
Sensor Web•
Personalisation•
Sentiment Analysis•
Teleportation(?)
:
INTERACTION DESIGN
Interaction Platform-
specific Knowledge
Desktop PC (Web)
Mobile
TableTop
Interactive TV
Wall
Embedded Appliance
•
General Design Knowledge
:
-
Event Detection & Similarity
Museum Information
Clip searching during TV watching
In-Home Power Monitor
Collaborative media searching
LifeLogging
Lee H, Smeaton A.F, O'Connor N, Jones G, Blighe
M, Byrne D, Doherty A and Gurrin C. Constructing a SenseCam Visual Diary as a Media Process. Multimedia Systems Journal, 14(6), 2008.
UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE
Conclusion
In designing novel applications that incorporate novel technologies:
Be aware of exciting new technologiesPlenty solutions but no problem?
Build working prototypes first, THEN worry about fitting them to real world
Lack of domain knowledge shouldn’t be the bottleneck in exploring new possibilities
Design expertise spanning multiple platform