multimedia applications technology domain roadmap & strategy

8/14/2019 Multimedia Applications Technology Domain Roadmap & Strategy

1/26

Copyright 2010 Symbian Foundation. 1

Multimedia Applications

Technology DomainRoadmap & Strategy

[email protected]


2/26

Outline MM Apps Overview Strategy in a Nutshell MM Apps Packages Stakeholder Needs Objectives How are we doing? Competitive Opportunities Roadmap S^3 specs Roadmap Scoped items Contribution Opportunities


3/26

MM Apps Overview (Slide 1 of 2)

Copyright 2010 Symbian Foundation.

Definition:The Multimedia Applications area encompasses all native multimediaapplications for device end-users which can be adopted unaltered, be

customized/differentiated or even replaced, according to stakeholders needs.

Related technology areas: Multimedia (OS & middleware), UI, Runtimes.

Key Drivers:Constantly increasing mobile handset capabilities (high resolution screens,better cameras, more storage, better processors), mobile networks

capabilities (high-speed data connections) and the social networking

revolution (photos/video/music sharing and streaming) have created the need

for more diverse and innovative mobile Multimedia Applications and services.

Such applications are becoming increasingly popular and are providing a

considerable source of revenue for key platform stakeholders, like application

developers, content providers and operators; their success is mainly depending

on if they manage to enable and deliver the best possible end user

experience .


4/26

MM Apps Overview (Slide 2 of 2)

Primary Stakeholders: Handset manufacturers Competitive and timely roadmap

Operators easy to differentiate, quick time to market

Content providers maximise target audience

End Users user experience, customise to needs/preferences


5/26

Strategy in a Nutshell (Slide 1 of 2)


M I D D L E W A R E

A P P L I C A T I O N S

Enduser

Multimedia Middleware

Runtimes O E M -

S p e c

i f i c

M u

l t i m e

d i a a p p

l i c a

t i o n

*

O E M

- S

p e c

i f i c

E x

t e n s

i o n *

Native Multimedia Apps

web application**

w e

b s e r v

i c e

p l u

g -

i n *

webserviceplug-in*

Webservicesenabler

(i.e. SMF**)

** Areas that do not belong to the Symbian platform arerepresented with grey

* Social Media Framework


6/26


M I D D L E W A R E

A P P L I C A T I O N S

Enduser

Multimedia Middleware

Runtimes O E M -

S p e c

i f i c

M u

l t i m e

d i a a p p

l i c a

t i o n

*

O E M

- S

p e c

i f i c

E x

t e n s

i o n *

Native Multimedia Apps

web application*

w e

b s e r v

i c e

p l u

g -

i n *

webserviceplug-in*

Webservicesenabler

(i.e. SMF)

* Areas that do not belong to the Symbian platform arerepresented with grey

Qt framework

Strategy in a Nutshell (Slide 2 of 2)


7/26

MM Apps Packages (Slide 1 of 2)


Currently (S^3):

Applications

layer

Podcatcher

ImageEditor

VoiceRecorder

Camera

VideoPlayer

Radio

MusicPlayer Photos

VideoEditor

Middlewarelayer CameraServices


8/26

MM Apps Packages (Slide 2 of 2)


Main Upcoming Changes (S^4):

Applications

layer

Podcatcher

ImageEditor

VoiceRecorder

Camera

VideoPlayer

Radio

MusicPlayer Photos

VideoEditor

Middlewarelayer CameraServices

InternetRadio

TV


9/26

Stakeholder Needs (Slide 1 of 3)


Handse t manufacturers

Widest range of multimedia functionality Multimedia apps that blend seamlessly with other functionality Consistent performance

Supported for upgrades and extensions Easily customizable and tuned-> Scalability Easy to differentiate


10/26

Serv ice providers (operators, content providers) Consistently performing multimedia apps that do not need to be replaced Innovative features Easy to re-use and port Easy and efficient to extend, customize and brand Timely & accurate roadmap for timely productization Maximize target audience Easily tuned to handset capabilities (codecs, screen resolution, speakers) Blend seamlessly with native UI




11/26



End UsersNeed native Multimedia Applications that: Always play Always perform Are easy and intuitive to use Provide easy transition to other relevant apps Work well and blend with the handsets hardware Have quick start-up, small functional latency

And also: Are fun and enjoyable Are customizable to personal taste and needs Have innovative features

Have links to web content Provide social networking extensions Make it easy and fun to edit and share ones content


12/26

customisable

widest range offunctionality

edit & sharesocial networking

fun & e njoyable

play

playability

OBJECTIVESExtensibility &Differentiation

CompletenessCompleteness Extensibility &Differentiation

PerformancePerformanceInnovation &EnjoyabilityInnovation &Enjoyability

SPneeds

OEMneeds

End Userneeds

blend seamlessly

performance

upgrades &extensibility

scalability

differentiate

re-use

portconsistentlyperforming innovative

unique & e xclusivelydifferent

extend,customise &

brandtimely &accurate max target

audience

tunabilityeamlessperform

easy & intuitive app transition works well/blends withhardware

quick

innovative

UsabilityUsabilitymooth EvolutionSmooth Evolution

Needs mapped to domain objectives


13/26

Objectives


Usability:Intuitive, easy to use apps with consistentUI among them. Fewer apps that coverwider functionality. The UI must be funwithout being confusing or cumbersome.

Innovation & Enjoyability:Users must delight in the use of theirhandsets multimedia features. Incorporateall those innovative features from the socialmedia and networking world that makethem exciting and attractive.

Smooth Evolution:Make sure that MM Apps make the best of the Multimedia evolution strategy. Smoothmigration, no functionality lost acrossreleases, take advance of evolving APIframeworks to enhance usability and addnew features.

Completeness:Native multimedia apps that arecompetitive, sufficient, flexible (availablein stand-alone and embedded modes) andsupported for updates.

Extensibility & Differentiation:Export APIs that allow 3 rd partyextensions/plug-ins to be developed.

Emphasis on social media enablers andAPIs. Apps easy to be tuned/differentiatedto fit the phone creators/operators needs.

Performance:Ability to have multimedia apps runningsmoothly even while backgroundoperations are taking place. Minimal

latency.


14/26


Extensibility &Differentiation Enable social media features

How are we doing?

Innovation &Enjoyability D r i v e ide a s i mp le me n t a t io n !

F o c u s o n UI sability

Completeness The mos t MM-

fe a t ure - comple t e

pla t form ou t of t he box.

SmoothEvolution

Fi ne so fa r bu t S 3 t o S ^4

mig ra t io n will be t he maj o r challe nge

Performance Great, keepimproving!


15/26

Competitive Opportunities (Slide 1 of 4) Usability, Innovation &

Enjoyability:User experience is the number onecriterion that drives smartphone salesnowadays. Major improvements comingin S^3 & 4 to place Symbian in a morecompetitive position against opponentplatforms than it is now. However, still alot of work needed until we can claim welead the field.

Fewer and non-overlapping native apps that cover a broader range of functionality andseamlessly combine player, gallery, editing and browsing capabilities. Improve media galleries information visibility, browsing, sorting and searchability. Make greater use of the supported gestures: makes mobile experience easy, intuitive and fun! Improve accessibility and visibility of content file management and editing actions. Enable end user with more personalisation/customisation options for their apps Take up great additional innovative ideas contributed by the community, drive theirimplementation.

Initiatives:

Usability

Innovation &Enjoyability


16/26

Competitive Opportunities (Slide 2 of 4)

Completeness &Performance:The only platform that nativelyoffers such a great range of multimedia functionality. Nativemeans opportunity for optimalperformance, which is crucial forapps that edit content (e.g. videoediting). Most competitorplatforms do not currently offercontent editing natively.

Become excellent in functionality we already have a competitive advantage in, such as Imageand Video Editing: improve performance, power efficiency and UI, add new attractive features. Identify which missing attributes the operators and OEMs are looking for when they often

replace native apps. Engage with community to discover and enable new competitive features, drive contributions.

Ability to keep release code in sync with contributor product code updates/upgrades.

Completeness

Initiatives:

Performance


17/26

Competitive Opportunities (Slide 3 of 4)

Extensibility & Differentiation:Flexibility to accommodate the stakeholders customised needs is what makes a platformtruly versatile and drives its wide adoption:Scalability for device creators, differentiationfor operators, tunability for service providersand extensibility for developers. Although weare doing fairly well in these areas, a lotremains to be done until we are regarded as

highly competitive.

Focus on enabling attractive and popular social media and networking features; incorporateSocial Media Framework (SMF) in this effort. Ability to provide feedback to the application about the device features and capabilities, so

that the application can adapt itself to the device specs. Provide skinning framework to enable easy differentiation and branding.

Initiatives:

Extensibility &Differentiation


18/26

Competitive Opportunities (Slide 4 of 4) Smooth Evolution:

The Multimedia framework evolution covers alllevels: OS (NGMA), Middleware (g streamer,OpenMAX IL), Apps (Qt). By now plans for S^4 arequite visible and communicated. However in app APIlevel, although having the Qt framework as part of S^4 is a very positive step, we are still lacking aconcrete API framework strategy that will allow us todrive the evolution to the right direction further than

just the next release. Migration of MM apps to Qt forS^4 on its way.

During migration we need to ensure the quality is maintained and no functionality is lost. Carefully look into the API framework options for S^5 and onwards; evaluate and activelyparticipate in the Qt Mobility APIs creation by stating the platform needs and giving the Qtteam feedback. In the context of Symbian platform dynamics (transition through releases) take into accountregression:

- Portability from previous adopted framework- Forward compatibility (how long is framework going to be supported for)

Initiatives:

SmoothEvolution


19/26

Roadmap S^3 specs (Slide 1 of 3)

Camera

Still image capture and video recording Standalone or embedded mode Still image settings (scene mode, flash,

contrast, sharpness, white balance, red-eye,timer, focal distance, face tracking, imagequality, sepia/b&w/negative)

Video settings (scene mode, flash, contrast,sharpness, white balance, focal distance,video quality, aspect ratio, sepia/b&w/

negative) Basic file management, memory usage, use

image/video as (wallpaper/ringtone/contactimage etc.)

Primary/secondary camera use option, go tophotos app option

Continuous auto-focus for still image & videocapture

Touch UI control for enabling face tracking Support for AVC Main/High profile video

recording

Support for 16:9 aspect ratio still imagecapture

Support for MPEG-4 and AVC HD videocapture

Photos Explore, discover, retrieve and share imaging content Standalone mode Organize users image collection into various views based on metadata

& collection management Slide show & slide show settings (Image order, Music On/Off, Song,

Transition speed) Fetch image files for applications such as Messaging, Contacts Details dialog Consistent and fast image rotation User Experience improvements [View Transitions, Semi-transparency

screen furniture, UI Fade In/Out Effects] image viewing over HDMI Multi-touch gesture support Single Tap changes and grid view improvements (ODE/kinetic

scrolling)

Video Player Watch videos (local or streamed) and control video playback Standalone or embedded mode

Supports all those video and streaming formats that middlewaresupports Video collection with basic file management functionality File details dialog Settings (Video repeat mode, volume level, mute mode, auto-

disconnect time, RTSP access point, RTSP proxy settings) Video playback over HDMI Video playback view gesture support Symbian NGA support for video playback Marking mode implementation to my videos video list


20/26

Roadmap S^3 specs (Slide 2 of 3) Voice Recorder

Record audio from the environment and play backrecorded clips

Standalone or embedded mode Recording of memos and phone conversations MMS/Standard/High quality recording options Manage and share recorded sound clips

FM Radio

Manually tune into specific frequency or scanautomatically all audible stations

Standalone or embedded mode Support for Homescreen music widget Store and rename stations; support for 100 presets Restructure stations list

Supports various aspects of RDS with RDS RT+ also enables the recognition of songs

played in radio (Web, Artist & Title support) Support for song recognition web services Music Store support Support for USB headset

Music Player

Music playback, management and viewing of user's music collection

Standalone or embedded mode, active Idleand Homescreen plugins

Audio playback features: Local file & progressive download playback, playlistsupport, audio effects, support for monitoringand control of audio playback via other

applications, device media key control overplayback, Bluetooth remote control overplayback

Music collection features: Organize userscollection into various views based onmetadata, collection management, playlistcreation/editing/sharing, metadata editing

Integration with UPnP Kinetic scrolling Album art thumbnails displayed in collection

views

User Experience improvements [ViewTransitions, Semi-transparency screenfurniture, UI Fade In/Out Effects]

Music playback over HDMI Single tap changes


21/26

Roadmap S^3 specs (Slide 3 of 3)

Image Editor

Basic image manipulation and creative editing of stillimages

Embedded mode Effects, Tuning, Rotate, Resize and Crop Overlays (Bubble Text, Frames & Clip Arts) Red-Eye reduction Touch usability improvements Scribbling/drawing tool

Improved choices for exiting dialog

Podcatcher Podcasts aggregator (downloader & player) Allows subscriptions and managed download of

podcast shows RSS feed updating Loose integration for playback with music player

(for podcasts) and video player (for vodcasts) Persistent position for multiple shows Cover art support

Automatic/manual download Multiple languages Allows user-specified connection Support for bluetooth headset (for pause & play) Hardware button shortcuts

Video Editor

Basic Video editing with easy to useinterface

Embedded mode Change Sound Simple Cut & Merge Insert images, text or clips anywhere in

time Fix to the fullscreen viewing mode


22/26

Roadmap Scoped Items


Symbian^4 (slide 1 of 3)

Package Features Contributor

Photos Qt and Orbit-based views Nokia

CameraQt-based camera application engine (Camera)Additional screen resolution and layout support

Nokia

FM Radio

QT and Orbit-based ViewsContext API integrationSupport for integrated FM antennaSupport for USB Headset radios (FM, HD)Frequency StripPlay log history / RDS RT historyRadioDNS Web launch

Nokia


23/26





InternetRadio

Views in Qt; Improved graphics designBrowse all Stations by Genre/Language/Country/TopFind (Search) Station by keyControl Playback (Play / Stop / Volume / Audio Routing)Add the playing station to FavoritesBrowse & play from FavoritesBrowse & play from History

Keep Recently Played song list for connection to Music StoreModify Application Settings (such as: default data usage policies, accesspoints, etc)Have interoperability with other applications on mobile deviceManually Tune stationSupport LocalizationPlay a station from a Web Page

Nokia

VideoPlayer

File Details Dialog API removal

Video Player Startup API removal

Direct UI implementation using Qt based Orbit library

Nokia


24/26





Podcatcher Qt migration EmbedDev

Video Player

Direct UI implementation using Qt based Orbit library

File Details Dialog API removal

Video Player Startup API removal

Nokia

Image Editor Qt migration Ixonos

Video Editor Qt migrationSound editor

Ixonos


25/26

Contribution Opportunities


Feature

Face recognition

Image recognition

(Speech recognition)

Sound editor

Clock Radio

Audio & video bookmarks


26/26

Thank

you!

multimedia applications technology domain roadmap & strategy

Documents