sgn-5857 multimedia graduate seminarmoncef/sgn-5857-pcm/seminar_intro.pdfsgn-5857 multimedia...
TRANSCRIPT
SGN-5857 Multimedia Graduate Seminar5-8 credits (op)
Personal Multimedia Content Management
Moncef Gabbouj (Room TF 406)
Email: [email protected]
Place & time: Nokia IC, Wednesdays 13.00 - 16.00
First meeting: Wednesday 11 March 2009
Seminar webpage:
www.cs.tut.fi/~moncef/SGN-5857-PCM/SGN-5857-PCM.htm
Course Description
Recent developments in the area of personal content experience Personal content on the run
Metadata value, framework and how to generate it
User interfaces for mobile media
Applications
ReferencesReference book:
Personal Content Experience – managing digital life in the mobile age, Juha Lehikoinen, Antti Aaltonen, Pertti Huuskonen, and Ilkka Salminen, John Wiley & Sons, Ltd., 2007. http://eu.wiley.com/WileyCDA/WileyTitle/productCd-0470034645.html
The authors:
Juha Lehikoinen is Principal Scientist at Nokia Research Center. For the last years he has been involved in developing GEMS (Get-Enjoy-Maintain-Share) – a framework for personal content.
Ilkka Salminen, Research Manager, Nokia Devices
Antti Aaltonen, Research Program Manager, Nokia Research Centre
Pertti Huuskonen, Principal Scientist, Nokia Research Centre
Additional references: Recent journal, magazine and conference articles in the field.
ReferencesRelated books (Mobile & Wireless Communications)
Wireless Sensor Networks: Signal Processing and Communications
by Ananthram Swami (Editor), Qing Zhao (Co-Editor), Yao-Win Hong (Co-Editor), Lang Tong (Co-Editor)
Global Positioning Systems, Inertial Navigation, and Integration, 2nd Edition
by Mohinder S. Grewal, Lawrence R. Weill, Angus P. Andrews
S60 Smartphone Quality Assurance: A Guide for Mobile Engineers and Developers
by Saila Laitinen
Programming Mobile Devices: An Introduction for Practitioners
by Tommi Mikkonen
Indoor Radio Planning: A Practical Guide for GSM, DCS, UMTS and HSPA
by Morten Tolstrup
Ultra-Low Energy Wireless Sensor Networks in Practice: Theory, Realization and Deployment
by Mauri Kuorilehto, Mikko Kohvakka, Jukka Suhonen, Panu Hämäläinen, Marko Hännikäinen, Timo D. Hamalainen
What was said about the book?
―The new era of powerful, mobile computing and sensing devices
having ever larger memories and personal databases brings to light a number of difficult problems in software, interface design, search, organization of information, and methods for inferring context and for sharing personal content… The authors have done an admirable job at describing the problems and opportunities and, as such, this book should be on the shelves of researchers struggling to make these mobile devices truly valuable to the ever expanding number of their users.‖—David G. Stork, Chief Scientist, Ricoh Innovations
Ref.: http://as.wiley.com/WileyCDA/WileyTitle/productCd-0470034645.html
What was said about the book?
"The book is well referenced, and can serve as a jumping-off point for someone who wishes to get started in this fascinating area of research and development."
(Computing Reviews, May 15, 2008)
What was said about the book?
Personal Content Experience is a comprehensive introduction to mobile personal content. The book introduces and explores issues such as context capture, user interfaces for continuous mobile use, UI design for mobile media applications, metadata magic, virtual communities, and ontologies. User interactions and behavioural patterns with personal content are also covered, resulting in a ‗GEMS‘ lifecycle model for analysing media devices, services, applications, and user interfaces. In addition, the book describes an extensible software architecture targeted at content management in mobile devices, pointing out the essential topics that will benefit anyone developing mobile content-intensive applications and services.
Ref.: http://as.wiley.com/WileyCDA/WileyTitle/productCd-0470034645.html
What was said about the book?
Personal Content Experience:
Establishes a foundation for analyzing applications, services and user interfaces targeted at personal content.
Provides a strong industrial insight, combining hands-on examples, application concepts and software architecture descriptions with theoretical frameworks and models.
Offers a multi-disciplinary approach, considering both user perspective and technology aspects.
This book is a clear and practical guide to the field of personal content and will be invaluable to practitioners in mobile industry and digital content management, media-intensive application developers, content creators and distributors, academic researchers, and lecturers in computer science and multimedia.
Ref.: http://as.wiley.com/WileyCDA/WileyTitle/productCd-0470034645.html
Experience?
User Experience
"User experience" encompasses all aspects of the end-user's interaction with the company, its services, and its products. The first requirement for an exemplary user experience is to meet the exact needs of the customer, without fuss or bother. Next comes simplicity and elegancethat produce products that are a joy to own, a joy to use. True user experience goes far beyond giving customers what they say they want, or providing checklist features. In order to achieve high-quality user experience in a company's offerings there must be a seamless merging of the services of multiple disciplines, including engineering, marketing, graphical and industrial design, and interface design.‖
(Nielsen Norman Group, http://www.nngroup.com/about/userexperience.html)
Better Experience?
Video Network for Better Video Experience Less Pixilation, Delays & Glitches (CISCO Medianet)
Context-Based Managing and Sharing of Personal Contents on Experience Web1: Taketoshi Ushiama and Toyohide Watanabe
Recently the amount of personal contents which a person has to manage is increasing remarkably. We are working on Experience Web, which is a system for managing personal contents based on experiences of a user. Experience Web provides functions to integrate various types of personal contents in a unified manner, and enable a user to search them based on context. Personal contents represent activities of a user …. Personal contents are used more efficiently if they are shared [with] the users who attended the same activity. In this paper, we discuss the search that uses personal contents of other users.
1 Taketoshi Ushiama1 and Toyohide Watanabe , ―Context-Based Managing and Sharing of Personal Contents on Experience Web,” Lecture Notes in Computer Science, Springer Berlin / Heidelberg ISSN0302-9743 (Print) 1611-3349 (Online) Volume 4694/2008, in Knowledge-Based Intelligent Information and Engineering Systems DOI10.1007/978-3-540-74829-8, 2008
Experience Machines
EM: capturing and retrieving personal contentFundamental to human existence is the ability to capture, memorize and retrieve personal
experiences and to share them with others. After motors have supplemented our musclesand sensors have supplemented our senses, emerging computer systems are on the vergeof becoming intimate supplements to our memory. New generations of sensor technology,interaction methods and semantic computers enable the capturing and interpretation of aperson‘s daily activities and the pro-active assistance of these activities. Semanticcomputers are the engines of rich digital autobiographic archives that are intuitivelyaccessible for retrieval of personal content. New interaction methods turn computers intoexperience machines that allow a new and deeper sensory awareness of environmental,bodily and cognitive processes. This paper describes the value and exponential growth ofpersonal content, the urgent need of consumer applications to manage and utilize thiscontent and challenging dilemmas related to capturing and sharing personal content.
(Thematic network of IST: Anticipating Content Technology Needs, ACTeN:
http://www.acten.net/cgi-bin/WebGUI/www/index.pl/experience_machines,
Published August, 2004)
Table of ContentsChapter 1: Digital Memories and the Personal Content Explosion
1.1 Digital Us
1.2 You and This Book
1.3 Contents at a Glance
Chapter 2: Trends Towards Mobility
2.1 The New Nomads
2.2 Mobile Device Categories
2.3 Mobile Compromises
2.4 Because it Can!
2.5 Convergence
2.6 Wireless Revolution
2.7 Case Study: Mobile Music
2.8 References
Chapter 3: Mobile Personal Content Uncovered
3.1 First there were Files
3.2 Categorization
3.3 Characteristics of Personal Content
3.4 Mobile Personal Content
3.5 Content Wants to be Free?
3.6 GEMS, a Tool for Modelling Personal Content Experience
3.7 References
Table of ContentsChapter 4: Metadata Magic
4.1 Metadata for Consumers: A Brief Introduction
4.2 Metadata Creation
4.3 Metadata Maintenance
4.4 Relations Give Meaning
4.5 How does Metadata Benefit the User?
4.6 Existing Approaches
4.7 The PCE Trinity: Mobility, Context and Metadata
4.8 The Challenges: Universal Metadata, Extensibility, Abuse
4.9 Yet Another Challenge: Interoperability
4.10 The Dream: When Metadata Really Works
4.11 References
Chapter 5: Realizing a Metadata Framework
5.1 Metadata is a Solution . . . and a Problem
5.2 Challenges in Distributed Mobile Content Management
5.3 Different Types of Metadata
5.4 From Content Management to Metadata Management
5.5 Overall Architecture
5.6 Our Metadata Ontology
5.7 Making a Prototype Implementation
5.8 Facing Real Life
5.9 Metadata Processors
5.10 Summary
5.11 References
Table of ContentsChapter 6: User Interfaces for Mobile Media
6.1 Human in the Loop
6.2 Interacting with Mobile Personal Content
6.3 Interfaces for Mobile Media Devices
6.4 Designing a Mobile User Interface
6.5 Performing the GEMS Tasks
6.6 The Effect of Device Category on UI
6.7 Summary
6.8 References
Chapter 7: Application Outlook
7.1 General Characteristics of Mobile Applications
7.2 Location-Based Applications
7.3 Sharing and Communities
7.4 Games
7.5 Other Domains
7.6 References
Chapter 8: Timeshifting Life
8.1 Metadata in the Years to Come
8.2 Metadata Creation: Top-Down or Bottom-Up?
8.3 Show Me the Money
8.4 Obstacles in Reaching the Vision
8.5 From Databases to Lifebases
8.6 Move that Metadata!
8.7 References
Seminar Lectures and Time Table
1st meeting: 11.3.2009, 13.00-16.00
Presentation 1: Moncef Gabbouj, Introduction to personal multimedia content management and requirements to pass the course.
Presentation 2: Pertti Huuskonen (NRC), ―10 views to context awareness‖
Presentation 3: Ilkka Salminen (Nokia Devices), ―Developing extensible metadata ontology‖
2nd meeting, 17.3.2009, 13.00-16.00
Ville-Veikko Mattila (NRC), ―Mixed reality‖
Severi Uusitalo (NRC), ―Nokia image space‖
Seminar Lectures and Time Table
3rd meeting, 25.3.2009, 13.00-16.00
Iftikhar Ahmed (Nokia Devices), ―Content-based multimedia management for mobile devices‖
Dr. Esin Guldogan (TUT), ―CBIR system profiles‖
4th meeting, 1.4.2009, 13.00-16.00
Prof. Kaisa Väänänen-Vainio-Mattila (TUT-IHTE),‖Service user experience‖
Marko Helen, ―Tools for automatic audio management‖
Moncef Gabbouj, project assignments
Final Presentations:
Workshop 1: 29 April 2009, 13.00-16.00 CANCELLED
Workshop 2: 30 April 2009, 13.00-16.00 changed to Thursday 30 April 2009, 10.00-17.00
Possible Presentations/Project Topics
Presentation topics will be mainly based on relevant research work in the field and from the reference book listed earlier. Other sources can be proposed. The topics can include but are not limited to the following:
1. Meta data types, creation/extraction/capture, management, ontologies
2. User interfaces for searching, interacting, and design
3. GEMS: life cycle of personal multimedia content
4. Nokia image space, http://research.nokia.com/imagespace
Possible Presentations/Project Topics
5. Point and find, http://conversations.nokia.com/2008/09/24/point-and-find-uncovered-video/
6. Nokia challenge: Where was this Photo Taken, and How? in ACM MM 2009 Challenge: http://www.scils.rutgers.edu/conferences/mmchallenge/2009/02/02/nokia-challenge/
7. Location based applications
8. Content sharing, communities,
9. Mobile games and other applications10. Classify the following clip into speech and music segments:
http://www.youtube.com/watch?v=N6EYrqIn0yI
11. A working PCM system (perhaps focused on one type of media, e.g. music, images, video)
Project Topics Proposed by Lecturers
Dr. Esin Guldogan‘s Project Proposal:12. In this study, we have considered indexing and retrieval factors and/or parameters, which
affect CBIR performance in several system profiles. On the other hand, ―User Interfaces‖ have also important impact on performance of CBIR applications for different system profiles. User interface parameters can be defined for each system profiles, according to the technical specifications of each profile. Afterwards, several experiments can be performed for each profile (on different platforms having different user interface specifications) concerning the recommended UI parameters.
Iftikhar Ahmad‘s Project Proposal:13. Create file-store to store features for on device feature extraction module. More information
about Java file APIs on mobile device can found from the link below:
http://library.forum.nokia.com/topic/Java_Developers_Library/GUID-D69FC49D-783E-45CE-80D4-7A9F3EE08B2A/javax/microedition/io/file/package-summary.html
File API example
http://developer.sonyericsson.com/site/global/techsupport/tipstrickscode/java/p_jsr75_accessing_pim_fileconnectionapi.jsp
Course Requirements
To secure 5 credits (5 op) One oral presentation about your assigned topic or project,
Attendance and active participation in all meetings and workshops.
Additional 3 cr (3 op) can be obtained by Project work
Demo – poster showing the project results
5-page written report about the project work
The additional work can be done in pairs.
Presentations Schedule
Final Presentations:
Workshop 1: 29 April 2009, 13.00-16.00 CANCELLED
Workshop 2: 30 April 2009, 13.00-16.00 changed to Thursday 30 April 2009, 10.00-17.00
For everyone:
Oral presentation (20 min)
For those wishing to get 3 additional credits:
Demo or poster
5-page written report*
* Report must be submitted during the workshop to get the extra credits.
Presentations Schedule
Presentations Timetable:
Presentation/Project topic selection: 09.04.2009 (inform Seminar Instructor by email)
Email Presentation to Instructor: 27.04.2009
Oral Presentations, Project Demo and written report*: 29. and (if needed) 30.04.2009. Changed to Thursday 30 April 2009, 10.00-17.00
* Report must be submitted during the workshop to get the extra credits.
Participants
Participants 11.3. 17.3.
25.3.
1.4.
W1: 29.4CANCELLED
W2: 30.4
Adrian Hornsby X [email protected]
Vinod Kumar X [email protected]
Olcay Guldogan X [email protected]
Hanna Silen X [email protected]
Petros Belimpasakis X [email protected]
Dave Murphy X [email protected]
Murat Birinci X [email protected]
Danai Skournetou X [email protected]
Muhammad Ahsan X [email protected]
Tembalethu Ndwe X [email protected]
Kemal Ugur X [email protected]
Rod Walsh X [email protected]