international telecommunication union mar del plata, argentina, 2 september 2009 multimedia...

InternationalTelecommunicationUnion

Mar del Plata, Argentina, 2 September 2009

Multimedia Application FrameworkQ13/SG16

Marcelo Moreno

Multimedia Networking ResearcherTeleMidia Lab - PUC-Rio

[email protected]

Seminar on ITU-T hot topics for Standardization

(Mar del Plata, Argentina, 2 September 2009)


Mar del Plata, Argentina, 2 September 2009 2

Introduction

Multimedia Applications for IPTV

Interactivity

Services

Games

And more…


Introduction

IPTV set-top boxesMultiple vendorsMultiple platforms

Multimedia Applications must be platform-independent

Interoperability is mandatoryContent creators/providers need a common application framework



H.IPTV-MAFR

ITU-T’s effort to identify and harmonize the relevant multimedia application frameworks

Established technologiesNew emerging technologies

Question 13, Study Group 16Multimedia application platforms and end systems for IPTV



H.IPTV-MAFR

Set-top box vendors will be able to compete in multiple markets

Migration between markets is supported choosing well-known MAFR standards

Hybrid set-top boxesComponent-based enginesConfigurable systems

Content interchange



H.IPTV-MAFR

MAFR can be classified by the authoring paradigm

Declarative Application Frameworkse.g.: HTML, BML, SVG, NCL…

Procedural Application Frameworkse.g.: Java (MHP)…

2 recommendations approved

13 working documents



H.760 (ex-H.IPTV-MAFR.0)

H.760 - Overview of multimedia application frameworks for IPTV services

Identifies and briefly describes the relevant standards of multimedia application frameworksInteroperability and harmonization in IPTV services



H.760 (Overview)

Declarative application frameworks:BIFS, BML, CEA-2014, CSS, DOM, DVB-HTML, EcmaScript, HTML, LASeR, MHEG-5, NCL, SVG, WTML

Procedural application frameworksGEM-based frameworks, M3W

Annex A describes common usage of web-related technologies (HTML, DOM, CSS, EcmaScript)



H.761 (ex-H.IPTV-MAFR.9)

Nested Context Language (NCL) and Ginga-NCL for IPTV services

NCL is a glue language that holds media together in a multimedia presentation, describing relationships among media objects in time and spaceXML-based, high-level constructsGinga-NCL is an NCL presentation engine built as part of an IPTV middleware



H.761 (NCL)

NCL highlights:Code reuseMultidevice support (in a home network)Content adaptabilitySpatiotemporal media synchronizationNo restrictions about media objectsProcedural code handled as a media object. Native scripting in LuaOpen-source reference implementation



H.IPTV-MAFR.1

Binary Format for Scene for IPTVScene description language, a part of MPEG-4 standard.Designed to allow for the efficient representation of dynamic and interactive presentationsDescription of the spatial and temporal organization of the different scene components.



H.IPTV-MAFR.2

Broadcasting Markup Language for IPTV (BML)

Declarative application specification for multimedia broadcasting in JapanStandardized by ARIB.BML consists of XHTML, CSS, Document Object Model (DOM) and ECMAScript.BML defines additional API and objects for IPTV using ECMAScript.



H.IPTV-MAFR.3

CEA-2014 for IPTV Remote User Interface specificationAllows a user interface to be remotely displayed on devices.Based on existing web technologies XHTML, EcmaScript, CSS and DOM 2. It is a web based protocol and framework for Remote user interface (UI) on UPnP Home Network and over Internet.



H.IPTV-MAFR.4

Cascading Style Sheet for IPTVCSS is a Style sheet language by W3CUsed to describe the presentation of a document written in a markup language.A CSS can be either linked to a document through a URI or included in the document.Does not constitute by itself a MAFR



H.IPTV-MAFR.5

Document Object Model for IPTVPlatform-, language-neutral interfaceAllows programs and scripts to dynamically access and update the content and structure of documents.It does not constitute by itself multimedia framework but is used with some markup languages.



H.IPTV-MAFR.6

ECMAScript for IPTVScripting language by ECMAUsed on the Web and supported in many applicationsIncluded as a component in many presentation engines (PE) such as BML and DVB-HTML



H.IPTV-MAFR.7

LASeR and SAF for IPTVMPEG-4 Part 20, designed for representing and delivering rich-media services to resource-constrained devicesIt defines two binary formats: LASeR, a binary format for encoding 2D scenes; and SAF, a binary format for aggregating in a single stream LASeR content with audio/video streams.



H.IPTV-MAFR.8

MHEG-5 for IPTV Represents an application as a set of scenes based on synchronization and spatial-temporal relationships of multiple media formatsIt supports structural composition, event-action associations, navigation, and user interaction capabilities.



H.IPTV-MAFR.10

Scalable Vector Graphics for IPTVDescribes 2D graphics and graphical applications in XML.Allows for three types of graphic objects: vector graphic shapes, images and text.Drawings can be interactive and dynamic. Animations can be defined and triggered either declaratively or via scripting



H.IPTV-MAFR.11

Worldwide TV Markup Language IPTV Content format for delivery using Internet Servers.Supports key features to enable service-oriented applications.Platform comprises a micro-browser and a markup language (WML 1.3 spec).User agent behavior is more sophisticated than a standard internet based HTML browser.



H.IPTV-MAFR.12

MPEG Multimedia Middleware IPTV M3W Multimedia platform API defines mainly audio and video processing APIs handling front-end, decoders and post-processing of A/V.M3W Multimedia APIs offer a high-level API that is independent of the target hardware. Focus on MPEG technologies.



H.IPTV-MAFR.13

HTML for IPTVHypertext Markup LanguageXHTMLDHTMLHTML profile for IPTV



H.IPTV-MAFR.14

Lua for IPTV servicesExtension programming language to support procedural programming with data description facilities.Lua is intended to be used as a powerful, lightweight scripting language.Lua engine is small and easily portable to several hardware platforms.The Lua engine is distributed as free software under the MIT license.



Final Remarks

Market is in serious need of standardized interoperable solutions.

Interoperability will provide benefit for all and encourage growth of the multimedia application market.

• The H.760 recommendation series standardizes the relevant MAFR technologies.



Final Remarks

• Interoperability is achieved through configurable platforms that can be adapted to specific MAFR subsets.

• The use of standardized, media-independent glue language is also a good solution for interoperability and harmonization.

• MAFR discussions are under way in Q13/SG16, a highly active question.



Mar del Plata, Argentina, 2 September 2009

Thank you

Marcelo Moreno

Multimedia Networking ResearcherTeleMidia Lab - PUC-Rio

[email protected]

Seminar on ITU-T hot topics for Standardization

(Mar del Plata, Argentina, 2 September 2009)

international telecommunication union mar del plata, argentina, 2 september 2009 multimedia...

Documents

iptvmafr mafr

iptv css

iptvmafr set

iptv platform

iptv services ncl

iptv middleware

iptvmafr ituts effort

multimedia framework