mmt and dash - krnet · summary of dash 17 mpeg-dash is a client-centric solution. the client can...
TRANSCRIPT
2012/4/19
KRnet 2014 (2014-06-24)
MMT and DASH over All-IP Network
2014. 06. 24
박경모 책임
KRnet 2014, H-1. Multimedia Networking
If you are interested in any of the following: Streaming audio and video to Smartphone, Tablet, PC, SMART
TV, or UHDTV over the Internet.
IP Broadcasting and Hybrid delivery services for multimedia.
Sending video on demand with QoS (Quality of Service)
Streaming multimedia with QoS or QoE (Quality of Experience)
You should learn about this.
Contents
Ⅰ MPEG-DASH
Ⅱ MPEG-MMT
KRnet 2014, H-1. Multimedia Networking
Video will dominate the Internet and Mobile
Internet Real-time video is 50% of the traffic at peak periods
notably 28.18% from Netflix and 16.78% from YouTube*
Mobile Video traffic is growing exponentially & is a large portion
Source: Cisco White Paper:
Cisco Visual Network: Index:
Global Mobile Data Traffic Forecast
Update, 2010-2015
69.1%
* source : sandvine
KRnet 2014, H-1. Multimedia Networking
Cloud applications and services also dominate
Cloud Video many Internet video applications can be categorized as cloud applications, mobile cloud traffic follows a curve similar to video.
Netflix, YouTube, Pandora, and Spotify allow mobile users to overcome the memory capacity and processing power limitations of mobile devices. Mobile Video Will Generate Over 69 Percent of Mobile Data Traffic by 2018
Source: Cisco White Paper:
Cisco Visual Network: Index:
Global Mobile Data Traffic Forecast
Update, 2010-2015
KRnet 2014, H-1. Multimedia Networking
The generation of the high quality and combined multimedia consumption
at the various devices with no constraint of user environments”
All IP,
Clouds 2011 2015 2020
Beginning Mobile media 1st generation of mobile media
Extension of mobile media
Completion of mobile media
Full HD 3D IPTV, Sat. Cable UHD
Terr. UHD broadcasting
Movement for Smart Multimedia Delivery
3D Earth
UD contents
KRnet 2014, H-1. Multimedia Networking
Contents
Devices
Network
• Immersive Contents (UHD)
• Smart interactivity
• Multiple contents on the screen
• High Speed Broadcasting Network
• Emerging Broadband Network
• Hybrid Delivery
• Larger Screen Devices.
• Multimedia Devices everywhere.
• Single service on the multiple Screens
Trends in Broadcasting
2012/4/19
KRnet 2014 (2014-06-24)
MPEG-DASH (ISO/IEC 23009-1)
KRnet 2014, H-1. Multimedia Networking
User Frustration with Internet Video
Can’t access the content
Behind a firewall
Bandwidth not sufficient
Wrong format
Wrong DRMs
Wrong device
Background
Low quality of experience
Long start-up delay
Frequent re-buffering
Low playback quality
No lip-sync
No DVD quality (language, subtitle)
Apple
Microsoft
Adobe
“HTTP Live Streaming”
“Smooth Streaming”
“HTTP Dynamic Streaming”
IETF
“HTTP Streaming”, “HTTP Progressive Download”
The need for an interoperable universal standard that can work on today’s Internet infrastructure and delivery a consistent high quality
experience to the end user.
KRnet 2014, H-1. Multimedia Networking
What is DASH?
Dynamic Adaptive Seamless rate adaptation Random access & Trick mode support
Streaming Not (progressive) download Including “Live” streaming
HTTP Assuming legacy HTTP 1.1 service & client HTTP cache mechanism
KRnet 2014, H-1. Multimedia Networking
HTTP Adaptive Streaming – Common Understanding
HTTP (RFC2616)
Application layer protocol (over TCP), presume a reliable Transport layer protocol for host-to-host data transfer.
request-response protocol in the client-server computing model. Intermediate network elements to improve or enable communications between clients and
servers (proxy and/or web cache). HTTP Resources are identified and located on the network by Uniform Resource Identifiers
(URIs) or, more specifically, Uniform Resource Locators (URLs) using the http or https URI schemes.
Source : DASH Workshop (T. Stockhammer)
KRnet 2014, H-1. Multimedia Networking
MPEG-DASH (ISO/IEC 23009-1)
A New Standard : ISO/IEC 23009-1 Efficient solution for HTTP-based streaming of MPEG media
Objectives A specification defining standard delivery format for streaming multimedia
over Internet.
A standard for building interoperable solutions by various vendors.
provides formats to enable efficient and high-quality streaming over the Internet
IS published (2012) ISO/IEC 23009-1, Media Presentation Description and Segment Formats
extensions to ISO Based Media File Format to support DASH (ISO/IEC 14496-12/AMD3)
Common Encryption 23001-7 with AES-128 CTR
KRnet 2014, H-1. Multimedia Networking
Scope of the MPEG-DASH
MPD and Index information for DASH access client Core specification aspects of DASH
Initialization and Media Segment for Media engine Reuse of existing container formats and easy conversion
KRnet 2014, H-1. Multimedia Networking
Example of DASH
* Period : Time sequence of Media Presentation * Representation : Encoded version of media component * Random access & Trick mode support
KRnet 2014, H-1. Multimedia Networking
MPD hierarchical model
Splicing of arbitrary content
Selection of Components
Select/ Switch of Bandwidth
Set of switchable Representation
KRnet 2014, H-1. Multimedia Networking
Example Deployment Architecture
Content Preparation
Ingestion component
Content Cloud Services (HTTP caching servers) IP Networks DASH Client
Original Content Original content encoded into video streams at different media bitrates
Packages video streams into video files MPD file generated for the video files URL generated for MPD files URI indicated for each Media Segments
HTTP Delivery
All intelligence in the client side Accesses MPD file based on URL & makes requests for appropriate video file adjust media rate based on network conditions
KRnet 2014, H-1. Multimedia Networking
Intelligence in Client-based control
16
The Client has significant information on its consumption environment (processing power, display, access bandwidth, etc.) and can directly select and dynamically adjust to these changing conditions.
The client can implement many smart measures to optimize quality and throughout such as buffering, load balancing, multiple connections and so on.
The client can directly react to user interaction
It permits to use standard HTTP servers permitting massively scalable and cost-efficient distribution of high-quality content.
It permits stateless distribution of content, i.e., the network does not have to maintain 1:1 connection for a session.
Source : DASH Workshop (T. Stockhammer)
KRnet 2014, H-1. Multimedia Networking
Summary of DASH
17
MPEG-DASH is a client-centric solution.
The Client can control the QoS for the user in a DASH-based deployment
MPEG-DASH
Standardization is completed (ISO/IEC 23009-1)
— harmonized industry standard for OTT video
— applicable to TV and mobile world
Support the client in making smart decisions by providing available information to client
— specified the MPD describes accessible Segment and corresponding timing.
— focused on Segment formats based on MPEG container format.
Use general purpose tools for controlling HTTP/TCP applications (TCP CC, HTTP codes, etc.)
Use existing control mechanisms (DRM authentication, HTML5/Web tools).
KRnet 2014, H-1. Multimedia Networking
MPEG-DASH Status
18
Latest status in MPEG DASH
23009-1 2nd Edition FDIS, Amd1 support for event messages and extended
audio channel configuration (Aug. 2013)
23009-2 FDIS, Conformance and reference software (Aug. 2013)
23009-3 DTR, Implementation Guidelines (Aug. 2013)
Descriptions of Core Experiments on DASH amendment
— Metadata track
— DASH Authentication for Content URL validation
— Server and Network assisted DASH operation
— Controlling DASH client behavior
— Spatial relationship description
Technologies under Consideration
— Low latency live support
— Improved relations for advanced media (e.g. depth)
KRnet 2014, H-1. Multimedia Networking
Forward looking
19
Open sources
The MPEG-DASH conformance and reference software provides the ideal playground for researchers as it can be used both to generate and to consume bitstreams compliant to the standard.
(http://www.dashif.org/)
(http://gpac.wp.mines-telecom.fr/) http://www-itec.aau.at/dash/
2012/4/19
KRnet 2014 (2014-06-24)
MPEG-H, MMT (ISO/IEC 23008-1)
KRnet 2014, H-1. Multimedia Networking
Future Broadcasting
Enjoy very high quality and combined multimedia consumption at the
various devices with no constraint of user environments
VOD
Live streaming
File
widget
E-book
UHD
metadata
Broadband
Broadcast
Mobile
UHD : Ultra High Definition VOD : Video on Demand
Hybrid
KRnet 2014, H-1. Multimedia Networking
Future Multimedia Services
Evolution : High Quality Contents and High Speed Network
Revolution : Data Broadcasting, Multiple Screens, Hybrid Network
Big Screen
UHDTV
Multiple Screens
Mobile HD
Data Broadcasting Hybrid Network
(Bi-directional services)
(w/ sync-ed services)
KRnet 2014, H-1. Multimedia Networking
Future Broadcast Requirement
• IP based multimedia delivery for all kinds of devices
– Many service provider and broadcaster believes, all IP based network
environment is for the future delivery.
• QoS/QoE enhanced media delivery over IP
– People wants to enjoy HDTV experience regardless of underlying network
types; No buffering time, constant and high quality.
• Not only AV but also ‘new media’ and ‘non-timed media’
– New media: Augmented Reality can be presented over video.
– Non-timed media: Widget and image can be presented over video.
• Storage and streaming in common format
– More streamlined and simple format for media delivery.
• Operator manages core and fundamental service description
– Complex presentation but simple and light composition format.
KRnet 2014, H-1. Multimedia Networking
Analyzing the improvement factors
New standard should be substantially better than MPEG-2 TS and MP4/HTTP, RTP/RTSP and combinations – It would be nice if it is a companion to
MPEG-2 TS
MPEG-2 TS is overloaded new solution might be required – Buffering models are getting complicated
(e.g. MVC/SVC over TS)
– Running out of code points
– TS/PES size is not suitable to emerging services (e.g. UHD)
New standards are required for – Converged application (Adaptive and/or
Progressive Download)
– Unmanaged environment
– Fixed and mobile convergence
– Hybrid delivery (Broadcast and Internet, Push/Pull/Unicast/Multicast/Overlay Multicast)
Internet Layer (IP)
Transport Layer (TCP, UDP)
Application Layer
(e.g. HTTP, RTP)
Delivery Layer (MPEG-2 TS, MP4
File)
Synchronization Layer
(MPEG-2 PES, MPEG-4 SL)
Compression Layer (Audio ES, Video ES)
• ES/SL/TS over RTP
• TS over UDP
• File over HTTP
• TS over HTTP
KRnet 2014, H-1. Multimedia Networking
• New MPEG transport solution for IP environment
• More flexibility on content consumption and delivery
• Suitable for 1 to 1 as well as 1 to M transmission
P1 MPEG Media Transport
• HEVC provides a novel video format with a compression capability twice that of AVC ( to be
done by 2013.1Q)
• Extensions for support of higher bit-depth, color sampling beyond 4:2:0, stereo/multiview
(MVC-like) expected early 2014
P2 High Efficiency Video Coding
• “Home Theater” : More Speakers, Immersive 3D Audio
• “ Enhanced Personal System” : Immersive Audio in Portable Device
P3 3D Audio
MPEG-H MMT: An Emerging MPEG Standard for Multimedia Delivery over the Internet
KRnet 2014, H-1. Multimedia Networking
MMT – New Global Standard
New global standard for media delivery and encapsulation
MMT allows broadcasters to move to IP without losing the major advantages of MPEG-2 TS (e.g. tight synchronization, clear buffer model) while also reducing complexity and overhead
MMT integrates fully with HTML5 and IP technologies
MMT provides excellent support for hybrid delivery of multimedia services
MMT is well suited to fixed and mobile reception
KRnet 2014, H-1. Multimedia Networking
• Support any type of data (Video, Audio, Apps )
• Single format for transmission and storage
• Adaptation considering NW condition is possible
01 Media Encapsulation
• HTML 5 + enhancement for Media Consumption
• Supports any kinds of devices with a single presentation
• Temporal, Spatial and event based presentation is possible.
02 Media Presentation
• Most suitable IP based scheme for MPEG Media
• Network based adaptation is possible with CLO.
• Server controls NW resource.
03 Transport
MPEG-H Part 1 MMT
VOD
Live streaming
File
widget
E-book
UHD
TV
`
Windows Media
Encoder
Windows Media
Server
PC Streaming
Media Portal
Symbol Description
Delivery over DSL
Subscriber
Management
EPG
DServer Media Router
Acquisition Server
Live Encode
TV2 Headend
Symbol Description
Delivery over DSL
TV2 uses a Windows Media
Server farm as its media store.
Media delivered to the PC may
also be delivered to the TV,
including Video, Music and
Photos.
The TV2 Notification Web
Service supports integration
with voice (Caller ID and SMS)
as well as data (Instant
Messaging, Alerts) services.
TV2 and the
Streaming Media Portal
IP network
MMT Packets
MMT Packets
MMT Packet
metadata
Hybrid delivery
Multi-service/context aware
Adaptation
MMT Package
MMT assets
KRnet 2014, H-1. Multimedia Networking
MMT – Functional Areas
• Functional areas – Encapsulation
• Container Format
• Media Packetization
• Media Fragmentation
• Media Synchronization
• Content Protection
– Delivery
• Network flow multiplexing
• Network Packetization
• QoS, AL-FEC, ARQ
– Signaling
• Information for Media Consumption
• Information for Media Delivery
Media Coding Layer
Encapsulation Function
Delivery Function
Transport Protocol (TCP, UDP)
Signaling Function
Internet Protocol (IP)
KRnet 2014, H-1. Multimedia Networking
MMT Architecture & protocol stack
KRnet 2014, H-1. Multimedia Networking
MMT – Content Model
Package can be logically defined for dynamic creation of
mash-up service
Each Access is associated with
delivery characteristics
information
Temporal relationship information is
provided to optimized delivery order
Asset (and MPU) is uniquely identifiable
for distributed caching and named
based search
* CI provides information for associating assets to a specific screen for multiple screen presentation environments.
KRnet 2014, H-1. Multimedia Networking
MMT Package instantiation, packetization
KRnet 2014, H-1. Multimedia Networking
IP Broadcasting over MMT
technology media synchronization channel change time UTC
MPEG2-TS STC-based DTS/PTS up to 2 seconds not supported
DASH on eMBMS DTS/PTS (always relative time) 2~4 sec. not supported
MMT UTC-based DTS/PTS up to 1.4 sec. supported
KRnet 2014, H-1. Multimedia Networking
Hybrid delivery over MMT
technology Ad insertion presentation synchronization
MPEG2-TS static not supported not supported
DASH on eMBMS flexible at media level maybe supported with HTML5 possible with MPD update in advance
MMT flexible at media and
packet level fully supported with MPEG-H CI
and HTML 5 fully supported with MPEG-H CI
KRnet 2014, H-1. Multimedia Networking
Targeting Specific Audience Group over MMT
KRnet 2014, H-1. Multimedia Networking
Presenting the Multiple Content Items in MMT
KRnet 2014, H-1. Multimedia Networking
MMT – Encapsulation
Media Fragment Unit – a generic container format, independent of any specific media codec, containing coded media data
that is independently consumable by a media decoder. – equal to or smaller than an Access Unit (AU) and contains information that can be utilized by
delivery layers. – aligned to “NAL” concept in AVC series standards (including HEVC)
MMT Processing Unit – a generic container format, independent of any specific media codec, containing one or more AUs
and additional delivery and consumption related information. – coded media data unit that can be completely and independently processed in MMT.
MMT Asset – data entity that is composed of one or more MPUs. – the largest data unit for which same composition information and data characteristics are applied. – contains only one kind of data type including packaged or multiplexed data
(e.g. a portion of audio ES, a portion of video ES, an MPEG-U Widget Package, a portion of MPEG-2 TS, a portion of MP4 file, and a portion of MMT Package).
MMT Package – MMT Package is a logical entity. – An MMT Package shall contain one MMT Composition Information (MMT-CI), one or more MMT
Assets and an associated MMT Asset Delivery Characteristics (MMT-ADC) for each MMT Asset
KRnet 2014, H-1. Multimedia Networking
MMT – Packetization
length (16bits) – This field indicates the length of the payload in bytes excluding the header.
type (8bits) − This field indicates the type of payload data.
f_i (2bits) − This field indicates the fragmentation indicator contains information about fragmentation of data unit in the payload.
fragment_counter (frag_count: 8 bits) − This field specifies the number of payload containing fragments of same data unit succeeding this MMT payload.
number_data_unit (numDU: 4 bits) − This field specifies the number of data unit within this MMT payload.
DU_offset (16bits) − This field specifies location of each data unit from the byte indicated by data_offset. This field shall be used, when aggregation_flag is set to ‗1‘.
payload_sequence_number (32 bits) − This field specifies the sequence number of payload associated with the same Asset.
KRnet 2014, H-1. Multimedia Networking
MMT Packet
Similar features to MPEG-2 TS packets
– Multiplexing of components into one delivery stream
– Interleaving of data from multiple components considering consumption order
– Random access indication
New features
– Assuming TCP/UDP/IP as underlying delivery layer protocol
– Carrying delivery time instance based on NTP for delivery jitter removal
– Two stage application layer FEC for strong error protection
KRnet 2014, H-1. Multimedia Networking
MMT – Signaling
Encapsulation Function
Delivery Function
Encapsulation Function
Delivery Function
Similar features to MPEG-2 Sections
– Carrying composition information
– Providing location information of components
– Structure supporting repeated delivery
– Hierarchical structure of information
New features
– Information for clock synchronization between MPEG-2 PCR and NTP
– Device Capability information and Downloadable DRM/CAS information are provided.
KRnet 2014, H-1. Multimedia Networking
Conclusion
MMT is a fully developed standard as an MPEG-H family (Systems).
MMT lies between HTML5 and IP — it connects them
MMT puts broadcaster in control of the hybrid broadcast/ broadband experience
Single solution for encapsulation, delivery and presentation
Designed for IP Packet based multimedia delivery
Packet oriented delivery and use of Internet protocols and functionalities (e.g. NTP)
Works over IP as well as non IP
Server/System driven streaming approach
QoS/QoE enhanced media delivery over IP
Not only ‘AV’ but also ‘non-timed media’
Data plane for the delivery of media data
Control plane for signaling/management of presentation and delivery
Enhanced Error Resilience : Two Stage AL-FEC (AL-FEC Framework)
KRnet 2014, H-1. Multimedia Networking 41