fully interoperable streaming of media resources in heterogeneous environments
DESCRIPTION
TRANSCRIPT
FULLY INTEROPERABLE STREAMING OF MEDIA RESOURCES IN
HETEROGENEOUS ENVIRONMENTS
Michael Eberhard MXM Streaming Framework 1
This work is supported in the context of the P2P-Next project (FP7-ICT-216217)
Michael EberhardChristian Timmerer
Hermann Hellwagner
Institute of Information TechnologyKlagenfurt UniversityKlagenfurt, Austria
OVERVIEW
Motivation
List of Technologies / MXM Engines
Architecture of the Streaming Framework
Demo of the Streaming Framework
Conclusions
Michael Eberhard MXM Streaming Framework 2
MOTIVATION
There is a strong need for Quality of Service and Universal Multimedia Access
When consuming content, the capabilities of the user‘s terminals and network connections are diverse
The content has to be provided over heterogeneous networks like the Internet
An interoperable solution to match the user‘s context and the quality of the content is desired.
Michael Eberhard MXM Streaming Framework 3
TECHNOLOGIES / MXM ENGINES MPEG Query Format
Perform queries for a list of Digital Items Provide a playlist with identifier and title
MXM Request Content Protocol Request a Digital Item and provide the UED/UCD Return the URL for the streaming session
MPEG-21 Digital Item Adaptation UED, UCD, and AQoS
MXM Media Framework Engine Media resource adaptation, streaming & decoding
Michael Eberhard MXM Streaming Framework 4
ARCHITECTURE OF THE STREAMING FRAMEWORK (1)
The VLC provides the streaming capabilities for both, the server and the client.
The VLC is extended with an MXM interface on the server-side to enable the setup of Video on Demand sessions utilizing MXM protocols.
The VLC GUI is extended with an MXM dialog on the client-side to provide the user with access to the Digital Items at the server.
Michael Eberhard MXM Streaming Framework 5
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 6
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 7
RequestPlaylist
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 8
MPQFRequest
<mpqf:Query> <mpqf:Input> <mpqf:OutputDescription> <mpqf:ReqField typeName="did:StatementType"> /dii:Identifier </mpqf:ReqField> <mpqf:ReqField typeName="mpeg7:CreationInformationType"> /mpeg7:Creation/mpeg7:Title </mpqf:ReqField> </mpqf:OutputDescription> </mpqf:Input></mpqf:Query>
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 9
RetrieveDIs
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 10
MPQFResponse
<mpqf:MpegQuery>…
<mpqf:ResultItem recordNumber="1">…
<did:Descriptor> <did:Statement mimeType="text/xml"> <dii:Identifier>exampleId</dii:Identifier> </did:Statement> </did:Descriptor> <did:Descriptor> <did:Statement mimeType="text/xml"> <mpeg7:Mpeg7>
… <mpeg7:Title>exampleTitle</mpeg7:Title>
… </mpeg7:Mpeg7> </did:Statement> </did:Descriptor>
…
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 11
ReturnPlaylist
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 12
ID, Preferences, Capabilites
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 13
RequestContent
<RequestContent> <mxmbp:TransactionID>rc1</mxmbp:TransactionID> <ContentIdentifier> <mxmbp:ContentItemIdentifier> exampleId </mxmbp:ContentItemIdentifier> </ContentIdentifier> <UsageEnvironmentDescription>
… <UniversalConstraintDescription>
…</RequestContent>
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 14
RequestContent
Response
<RequestContentResponse> <mxmbp:TransactionID>rc2</mxmbp:TransactionID> <ContentURL> <MimeType>video/mp4</MimeType> <URL>rtsp://143.205.123.54:5444/ID346582</URL> </ContentURL></RequestContentResponse>
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 15
AQoS
UED, UCD, DI-ID
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 16
RequestStream
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 17
Stream Adapted Media
ARCHITECTURE OF THE STREAMING FRAMEWORK (2)
Michael Eberhard MXM Streaming Framework 18
ARCHITECTURE OF THE STREAMING FRAMEWORK (3)
The media resources available at the server are requested using the MPEG Query Format (MPQF).
The request for the desired sequence is performed utilizing MXM‘s Request Content Protocol (including the usage environment conditions formatted according to MPEG-21 DIA).
The streaming and adaptation capabilities are provided by the VLC and ffmpeg.
Michael Eberhard MXM Streaming Framework 19
DEMO OF THE STREAMING FRAMEWORK
Michael Eberhard MXM Streaming Framework 20
WHY SHOULD WE USE THE MXM ENGINES?
It makes the implementation of customized multimedia demos/frameworks a lot easier
It ensures full interoperability thanks to MPEG, IETF, and W3C
An open source implementation is provided
Michael Eberhard MXM Streaming Framework 21
QUESTIONS?
Michael Eberhard MXM Streaming Framework 22
Thank you for your attention!