home gateway for three-screen tv using h.264 svc and raptor fec

1

Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC

IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, November 2011

Eun-Seok Ryu and Nikil Jayant

2

Outline

ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion

3

Background

ه Home Gatewayه The home gateway is an intelligent network interface device

located at the consumer premises.ه It enables residential user to access the internet services delivered

to home and also to access the different services offered by various smart devices located within home.

ه Three-screen Serviceه is a multimedia service and provides the right solution for

consumers to access rich multimedia resources on any device, anytime, and anywhere.

4

Background

ه Scalable Video Codingه H.264/SVC is in particular of importance because it envisions

methods for controlling video characteristics such as resolution, quality, and frame rate according to the network condition. For this purpose, SVC uses a layered coding approach to provide combined spatial, temporal, and quality scalabilities.

5

Background

ه Scalable Video Codingه SVC coding has several advantages :

1. reduce total bandwidth, storage, and computational complexity by supporting many clients with a single video content file.

2. applicable to many unequal error protection (UEP) methods using priorities of each layer.

3. SVC approach is inherently more robust because of its error resilient tools.

6

Background

ه Raptor FECه The Raptor FEC was developed by Amin Shokrollahi as one of

fountain codes in 2001 and is also called a rateless code.

ه Several standards have adopted Raptor code as a standard: ى Multimedia broadcast and multicast services (MBMS) in the 3rd generation

partnership project (3GPP)ى DVB-Hى Reliable multicast transport (RMT) working group within the internet

engineering task force (IETF).

ه The Raptor FEC can be designed with both the systematic and non-systematic approaches.

7

Background

ه Raptor FECه Encode

8

Outline

ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion

9

Introduction

ه According to the annual Cisco visual networking index (VNI) forecast: ه 2009-2014, the sum of all forms of videos will continue to exceed

91 percent of global consumer traffic.ى TVى VoDى internet videoى peer-to-peer

ه These show the importance of home multimedia technology in near future.

10

Introduction

ه Video service providers (VSP) are preparing premium services.

ه The home gateway and three-screen clients are as followed.

11

Introduction

ه A traditional solution for source coding is to prepare separate pre-encoded video streams according to the capability of each targeted device.

ه Another advanced solution is transcoding one high resolution and high bit rate video sequence for targeted screen sizes and bit rates of TV clients.

12

Introduction

ه This paper proposes an elastic video streaming solution for 3STV and home gateway.1. SVC source coding technology to support various device

capabilities with single bitstream.2. Raptor forward error correction technology to achieve strong

packet loss recovery feature in application layer.

13

Introduction

ه This paper proposes optimized video streaming methods with SVC and Raptor FEC.1. adaptive SVC layer-switching method, which enables the server

to perform selecting appropriate according to bandwidth.2. adaptive Raptor FEC method, which controls the overhead of

Raptor FEC according to PLR.

ه The advantage of an efficient combination of (1) and (2) is that1. the optimal layer numbers to be sent under permitted bandwidth.2. the overhead of Raptor FEC to protect the packets of selected

layers according to link quality.

14

Outline

ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion

15

Adaptive SVC Layer-switching with Raptor FEC Overhead Control

ه Conceptual procedures of the proposed methodه Received Signal Strength Indicator (RSSI)-based feedback

16

Adaptive SVC Layer-switching with Raptor FEC Overhead Control

ه System architecture of implemented home gateway

17

Adaptive SVC Layer-switching with Raptor FEC Overhead Control

ه Adaptive SVC Layer-switchingه is a reliable method for automatic switching between the several

spatial/temporal layers.ه is the easiest natural bandwidth adaptation method in the middle of

streaming.

18

Adaptive SVC Layer-switching with Raptor FEC Overhead Control

ه Adaptive Raptor FECه Raptor FEC shows excellent packet loss recovery results in

various PLR conditions, for any given overall FEC overhead rate.ه The proposed method determines the Raptor overhead according

to feedback of channel condition based on these experimental results as an overhead adaptation method.

19

Adaptive SVC Layer-switching with Raptor FEC Overhead Control

ه The flow chart of algorithm for SVC layer and Raptor overhead adaptation

20

Outline

ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion

21

Experimental Results

ه Implementationه The implemented environment for the 3STV home gateway

includes: ى two laptops with one large size TV, and one personal digital assistant (PDA). ى 802.11b wireless LAN is used for the in-home wireless network. ى TCP is used for sending control messages such as the feedback of channel

condition.ى Real-time Transport Protocol over UDP is used for streaming video sequence.

22

Experimental Results

ه Sample video sequences for three-screen TV

23

Experimental Results

ه Overall bit rate gains

24

Experimental Results

ه Performance of adaptive Raptor FEC and SVC layer-switching

25

Experimental Results

ه Comparison of video quality by streaming methods (from left 3%, 5%, 10%, and 15% PLR condition).

26

Experimental Results

ه Moving traces with mobile TV on building map

27

Experimental Results

ه Reactions of the proposed method in real moving experimentation using implemented home gateway system

28

Outline

ه Backgroundه Introductionه Proposed Methodه Experimental Resultsه Recent Researchه Conclusion

29

Multilevel Diversity Coding via Rateless Codes for Reliable and Scalable Video Multicasting

IEEE Communications Letters, Vol. 17, No. 5, May 2013

Mohsen Sardari, Eun-Seok Ryu, Faramarz Fekri, and Nikil Jayant

30

Multi-gateway Structure

ه Clients in different coverage regions can connect to a number of gateways (top).

ه Association of each client to more gateways result in higher quality (bottom).

31

Multi-gateway Optimization

ه Benefit : reducing the load on the backbone network.

ه This paper formulates the problem as an optimization problem with the objective of minimizing the total bandwidth of the scalable video delivery.

32

Multi-gateway Optimization

ه This paper first introduces an abstract model and describe the optimal solution for multi-gateway multicast of scalable content.

ه And demonstrates that traditional multicast, which requires all the gateways in the network fully deliver all the layers of a SVC content, is not optimal.

33

Multi-gateway Optimization

ه Consider a source node S which provides scalable video with L layers l1, . . . , lL .

ه This paper optimize for the total output rate of the S such that connection to any Nα number of gateways should enable the client to successfully receive layers {l1, . . . , lα}.

34

Multi-gateway Optimization

ه Consider the n-th gateway and let r1n , r2

n , . . . , rLn be the

rate of the layers 1 through L provided by S to the n-th gateway.

ه The total rate sent to n-th gateway :

35

Multi-gateway Optimization

ه To successfully recover a layer α, the sum of the rates rα ≥ 0 received by a client from all the gateways should be lα.

ه Therefore, constraints on successful recovery of layers result in the following optimization problem :

36

Multi-gateway Optimization

ه Thus, the dual problem of optimization with variables p1, . . . , pL, is

37

Multi-gateway Optimization

ه The solution of the optimization problem :

38

Multi-gateway Optimization

ه In [10], it is shown that given enough budget for storing a file in a distributed network, spreading of the budget maximizes the recovery probability for a collector with random access to a set of storage nodes.

[10] D. Leong, A. Dimakis, and T. Ho, “Distributed storage allocations,”IEEE Trans. Inf. Theory, vol. 58, no. 7, pp. 4733–4752, July 2012.

39

Achieving the Optimal Solution with Rateless Coding

ه Source S should provide every gateway the whole of layer 1, and 1/i of the layer i.

ه The property of rateless coding provides the flexibility to encode data on the fly and proves to be useful in achieving the optimal solution.

40

Comparison of the Optimal Solution with Simple Multicast

ه Gain of various layer growths

41

Experimental Results

ه Performance evaluationه Overhead r = 12%

42

Conclusion

ه Adaptive SVC layer-switching selects appropriate layers to be sent according to ABW by RSSI-based feedback.

ه Raptor FEC overhead control method controls its overhead according to PLR.

ه The proposed method outperforms traditional methods and enhances video quality from 2dB to 5dB while simultaneously reducing bitrates from 28% to 36% .