Consideration of a transport mechanism on broadcasting from the viewpoint of

emerging hybrid content delivery systems

Shuichi AOKI, Katsunori AOKI, Keigo MAJIMA, and Hiroyuki HAMADA

January 20, 2010 @Kyoto Research Park, Japan

Science and Technology Research Laboratories, Japan Broadcasting Corporation

MMT Workshop / the 91st MPEG meeting

2

Today’s presentationCharacteristics of broadcasting and telecommunication

MPEG-2 TS based hybrid content delivery system

Personalizing broadcast programs by using extra components

on telecommunication

IP-based hybrid content delivery system

A transport mechanism for IP packets over broadcasting

channels

An effective file-based broadcasting system

using telecommunication

Conclusions

3

Digital broadcasting

HDTV

Satellite Broadcasting

Terrestrial Broadcasting

UHF band

ISDBISDB--SSISDBISDB--TT

ISDB: Integrated Services Digital Broadcasting

Fixed reception

12GHz band

Broadcasting can stably provide content to many viewers at a time.

Mobile receptionOne-seg “digital terrestrial service for mobile devices”

*In the case of Japan

4

Telecommunication

Viewers obtain desired content from a wide variety of options.

Viewers request desired content at their convenience.

Telecommunication services effectively provide requested content, but suffers from congestion.

Limited network bandwidth.

Limited equipment throughput.

On telecommunication:

requestresponse

5

Combination of broadcasting and telecommunication

Stable, Point to Multi Point, Simultaneous, Unidirectional

Point to Point, Bidirectional, Congested

Service providerBroadcast Telecom.

Multimedia services

Hybrid systems leads to enriched multimedia services.

Broadcasting

Telecommunication

6

Today’s presentationCharacteristics of broadcasting and telecommunication

MPEG-2 TS based hybrid content delivery system

Personalizing broadcast programs by using extra

components on telecommunication

IP-based hybrid content delivery system

A transport mechanism for IP packets over broadcasting

channels

An effective file-based broadcasting system

using telecommunication

Conclusions

7

TS-based hybrid content delivery systemPersonalizing presentation of broadcast programs by using extra components on telecommunication.

Main Service Extra & Personal

Extra components

Telecommunication

Keep today’sMPEG-2 TS based digital broadcasting system unchanged

Extra components also delivered in MPEG-2 TS.

Personalized viewing

8

System architectureAt receiver, MPEG-2 TS in broadcasting and those in telecommunication are independently decoded.

Receiver

Video

AudioBroadcasting

Buffer

STC

PCRPCR

CL

Tuner & decoder

STC

Telecommunication

BufferIP reception& decoder

PTS

CLFixeddelay

＋

Shared

PTS

CL

Extra components(streaming video/audio etc)Broadcaster

Several components are decoded and presented in sync with each other after being buffered.

9

Network

Developed prototype – translated subtitle service

Receiver Network server

Translator software (To other languages) Multi-lingual subtitles with PTS

referring to broadcast PCR

Tuner

Presentation appear later than normal broadcast programs

PCR

Fixed delay

Subtitle msg dispatcher Recv

Actual broadcast program with subtitles

Subtitle extraction with PTS

Decoderw/ bufferTuner Sync

and present

Experiments to synchronize live-generated extra components with delayed broadcast programs

Decoder

10

Alternative transport for hybrid content delivery system

Method 1In the system, extra components delivered in MPEG-2 TS packets encapsulated into IP packets.

Receiver decodes TS in broadcasting and TS in telecommunication, separately.

IP pktTelecom.

Decoder

Decoder

Composition

Method 2One alternative transport for broadcasting is to transport IP packets in which coded signals are encapsulated. IP pkt

Telecom.

Signal

IP pktBroadcast

Signal

TS pktBroadcast

Signal

TS pktSignal

Decoder

11

Today’s presentationCharacteristics of broadcasting and telecommunication

MPEG-2 TS based hybrid content delivery system

Personalizing broadcast programs by using extra components

on telecommunication

IP-based hybrid content delivery system

A transport mechanism for IP packets over broadcasting

channels

An effective file-based broadcasting system

using telecommunication

Conclusions

12

A new multiplexing scheme for broadcasting systemTransporting IP packets over broadcasting channels enables broadcasting and telecommunication to harmonize.

Advanced satellite broadcasting system in Japan has two multiplexing schemes to efficiently transport IP packets.

Multimedia broadcasting

Real-time services File-based services

Video and audio

Data and control

Video, audio, and metadata file

Control signals

PES Section IP packet Signalling packet

MPEG-2 Systems TLV multiplexing scheme

Transmission slot (channel coding and modulation)

New scheme well-suited for transporting IP packetsTLV: Type - Length - Value

13

Difference of encapsulation

Video

Audio

PSI/SI

PES

PES

Section

TS packetData Section

Video

Audio

Metadata

FileFile

FileFile

IP packet

TLV packetTransmission control signals

MPEG-2 TS TLV multiplexing scheme

All information transported as fixed-length MPEG-2 TS packets.

All information transported as variable-length TLV packets.

TLV multiplexing scheme realizes common transport mechanism between broadcasting and telecommunication.

14

TLV multiplexing scheme overview

IP packets efficiently transported over broadcasting channels.

Three elements to efficiently transport IP packets

15

File delivery on the TLV multiplexing scheme

- Download header added to each unit.

- IP header information also added.TLV multiplexing scheme multiplexes constructed IP packets.

File attribute information

Segmentation

…. …..FileFile

Download header IP header and UDP header

IP packets

Data unit

Unit #(N-1)

Unit #N

Unit #1

Unit #(N-1)

Unit #N

…..

Unit #1

Unit #(N-1)

Unit #N

Unit #1

FileFile

Zip

FileFile FileFile FileFile

TLV multiplexing scheme developed for file-based broadcasting.

File delivery method with a small overhead also developed.File segmented into data units of given size.

File attribute information generated describing file ID, file size, file name, etc.

16

Today’s presentationCharacteristics of broadcasting and telecommunication

MPEG-2 TS based hybrid content delivery system

Personalizing broadcast programs by using extra components

on telecommunication

IP-based hybrid content delivery system

A transport mechanism for IP packets over broadcasting

channels

An effective file-based broadcasting system

using telecommunication

Conclusions

17

IP-based hybrid content delivery systemSystem can integrally provide popular content as well as requested content.

Tuner

Router

PacketIP

packetIP

File

packetIP

File server Router

PacketIP

Multiplexing

Service provider

HomeTelecommunication

Broadcasting

Packet

Compressed header

Popular content

License info.

Requested content

- Requested content and license delivered over telecommunication.- Popular content delivered over broadcasting channels.

18

Receiver configuration for the systemBroadcasting channels and telecommunication networks integrated as IP-path by TLV multiplexing scheme.

Broadcasting demod. and demux

IP multicast transfer process

IP unicast transfer process

Storagedevice

Electronic content guide

Decryptor

Demux

A/V decoder

Ethernet

IP packet

Control

Broadcasting

Receiver

Telecommunication

A/V out

IP packet

Many modules commonly used for broadcasting and telecommunication.

For broadcasting

For telecommunication

Common parts

19

Demonstration of developed prototypeDeveloped prototype demonstrated at NHK Science and Technology Research Laboratories open house in May 2009.

Service procedures and file delivery on prototype system demonstrated.

20

Standardization activities

TLV multiplexing scheme

Standardized in ARIB STD-B32 "Video coding, audio coding, and

multiplexing specifications for digital broadcasting“

Draft new ITU-R Recommendation "Multiplexing scheme for variable-

length packets in digital multimedia broadcasting systems“

agreed for adoption and approval in November 2009.

File-based broadcasting system

Under standardization at ARIB and ITU-R.

ARIB : Association of Radio Industries and Businesses

21

Today’s presentation

Characteristics of broadcasting and telecommunication

MPEG-2 TS based hybrid content delivery system

Personalizing broadcast programs by using extra components

on telecommunication

IP-based hybrid content delivery system

A transport mechanism for IP packets over broadcasting

channels

An effective file-based broadcasting system

using telecommunication

Conclusions

22

ConclusionsBroadcasting and telecommunication have different characteristics.

Combining different types of delivery media improves user experience as they complement each other.

Two hybrid content delivery systems introduced incorporating broadcasting and telecommunication.

MPEG-2 TS based system to personalize the presentation of broadcast programsIP-based system to effectively deliver file-based content

Hybrid content delivery systems increasing because of their usability.

Systems seek efficient and functional transport mechanism commonly used in both broadcasting and telecommunication.

Broadcast Telecom.Transport mechanism

Coded signals Control signals