fully interoperable streaming of media resources in heterogeneous environments

FULLY INTEROPERABLE STREAMING OF MEDIA RESOURCES IN

HETEROGENEOUS ENVIRONMENTS

Michael Eberhard MXM Streaming Framework 1

This work is supported in the context of the P2P-Next project (FP7-ICT-216217)

Michael EberhardChristian Timmerer

Hermann Hellwagner

Institute of Information TechnologyKlagenfurt UniversityKlagenfurt, Austria

OVERVIEW

Motivation

List of Technologies / MXM Engines

Architecture of the Streaming Framework

Demo of the Streaming Framework

Conclusions

Michael Eberhard MXM Streaming Framework 2

MOTIVATION

There is a strong need for Quality of Service and Universal Multimedia Access

When consuming content, the capabilities of the user‘s terminals and network connections are diverse

The content has to be provided over heterogeneous networks like the Internet

An interoperable solution to match the user‘s context and the quality of the content is desired.

Michael Eberhard MXM Streaming Framework 3

TECHNOLOGIES / MXM ENGINES MPEG Query Format

Perform queries for a list of Digital Items Provide a playlist with identifier and title

MXM Request Content Protocol Request a Digital Item and provide the UED/UCD Return the URL for the streaming session

MPEG-21 Digital Item Adaptation UED, UCD, and AQoS

MXM Media Framework Engine Media resource adaptation, streaming & decoding

Michael Eberhard MXM Streaming Framework 4

ARCHITECTURE OF THE STREAMING FRAMEWORK (1)

The VLC provides the streaming capabilities for both, the server and the client.

The VLC is extended with an MXM interface on the server-side to enable the setup of Video on Demand sessions utilizing MXM protocols.

The VLC GUI is extended with an MXM dialog on the client-side to provide the user with access to the Digital Items at the server.

Michael Eberhard MXM Streaming Framework 5

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 6

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 7

RequestPlaylist

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 8

MPQFRequest

<mpqf:Query> <mpqf:Input> <mpqf:OutputDescription> <mpqf:ReqField typeName="did:StatementType"> /dii:Identifier </mpqf:ReqField> <mpqf:ReqField typeName="mpeg7:CreationInformationType"> /mpeg7:Creation/mpeg7:Title </mpqf:ReqField> </mpqf:OutputDescription> </mpqf:Input></mpqf:Query>

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 9

RetrieveDIs

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 10

MPQFResponse

<mpqf:MpegQuery>…

<mpqf:ResultItem recordNumber="1">…

<did:Descriptor> <did:Statement mimeType="text/xml"> <dii:Identifier>exampleId</dii:Identifier> </did:Statement> </did:Descriptor> <did:Descriptor> <did:Statement mimeType="text/xml"> <mpeg7:Mpeg7>

… <mpeg7:Title>exampleTitle</mpeg7:Title>

… </mpeg7:Mpeg7> </did:Statement> </did:Descriptor>

…

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 11

ReturnPlaylist

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 12

ID, Preferences, Capabilites

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 13

RequestContent

<RequestContent> <mxmbp:TransactionID>rc1</mxmbp:TransactionID> <ContentIdentifier> <mxmbp:ContentItemIdentifier> exampleId </mxmbp:ContentItemIdentifier> </ContentIdentifier> <UsageEnvironmentDescription>

… <UniversalConstraintDescription>

…</RequestContent>

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 14

RequestContent

Response

<RequestContentResponse> <mxmbp:TransactionID>rc2</mxmbp:TransactionID> <ContentURL> <MimeType>video/mp4</MimeType> <URL>rtsp://143.205.123.54:5444/ID346582</URL> </ContentURL></RequestContentResponse>

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 15

AQoS

UED, UCD, DI-ID

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 16

RequestStream

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 17

Stream Adapted Media

ARCHITECTURE OF THE STREAMING FRAMEWORK (2)

Michael Eberhard MXM Streaming Framework 18

ARCHITECTURE OF THE STREAMING FRAMEWORK (3)

The media resources available at the server are requested using the MPEG Query Format (MPQF).

The request for the desired sequence is performed utilizing MXM‘s Request Content Protocol (including the usage environment conditions formatted according to MPEG-21 DIA).

The streaming and adaptation capabilities are provided by the VLC and ffmpeg.

Michael Eberhard MXM Streaming Framework 19

DEMO OF THE STREAMING FRAMEWORK

Michael Eberhard MXM Streaming Framework 20

WHY SHOULD WE USE THE MXM ENGINES?

It makes the implementation of customized multimedia demos/frameworks a lot easier

It ensures full interoperability thanks to MPEG, IETF, and W3C

An open source implementation is provided

Michael Eberhard MXM Streaming Framework 21

QUESTIONS?

Michael Eberhard MXM Streaming Framework 22

Thank you for your attention!