layer-aligned multi-priority rateless codes for layered video streaming
DESCRIPTION
Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming. IEEE Transactions on Circuits and Systems for Video Technology, 2014 Hsu-Feng Hsiao Yong- Jhih Ciou. Outline. Introduction Proposed Method Simulation Results Conclusion. Introduction. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/1.jpg)
1
Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming
IEEE Transactions on Circuits and Systems for Video Technology, 2014
Hsu-Feng HsiaoYong-Jhih Ciou
![Page 2: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/2.jpg)
2
Outline
ه Introductionه Proposed Methodه Simulation Resultsه Conclusion
![Page 3: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/3.jpg)
3
Introduction
ه Multimedia streaming is over error-prone networks within heterogeneous environments.
ه The heterogeneous environments also include the computational and display ability of the clients.
ه The connection quality from the server to each client may vary.
![Page 4: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/4.jpg)
4
Introduction
ه A traditional approach, simulcast, copes with heterogeneous environments through source coding, encoding videos into several bit-streams.
ه The disadvantages of simulcast appear when the number of users become large.
![Page 5: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/5.jpg)
5
Introduction
ه Compared with simulcast, streaming videos encoded using scalable video coding(SVC) can better fit the heterogeneous environments.
ه For a large number of message blocks, fountain codes can generate a virtually infinite number of coded blocks on demand and on the fly.
ه Other efficient coding methods include raptor codes [6], low density parity check codes [9] [10], Tornado codes [11], and online codes [12].
![Page 6: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/6.jpg)
6
Reference
[6] A. Shokrollahi, “Raptor Codes,” IEEE Transactions on Information Theory, vol.52, pp. 2551-2567, Jun. 2006. [9] R. Gallager, “Low-Density Parity-Check Codes,” IRE Transactions on Information Theory 8, no. 1, pp. 21-28 , Jan. 1962. [10] J. S Plank and M.G. Thomason “On the Practical Use of LDPC Erasure Codes for Distributed Storage Applications,” Technical Report UT-CS-03-510, University of Tennessee, Sep. 2003.[11] M. G. Luby, M. Mitzenmacher, M. A. Shokrollahi and D. A. Spielman, “Efficient Erasure Correcting Codes,” IEEE Transactions on Information Theory, vol. 47, pp. 569– 584, Feb. 2001. [12] P. Maymounkov, “Online Codes,” NYU Technical Report TR2003-883, 2002.
![Page 7: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/7.jpg)
7
Introduction
ه Traditional rateless codes can only provide equal protection for each message block.
ه A better approach is to intelligently protect the data according to its importance.ه Unequal Error Protection(UEP)
![Page 8: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/8.jpg)
8
Introduction
ه The contributions of this paper are as followsه An N-cycle layer-aligned overlapping structure is designed for
unequal error protection of data with multiple priorities.
ه An analytical model to predict the probabilities of the unsuccessful decoding of each part of the data is derived.
ه The protection strength required to achieve the best video quality on the receiver side can be decided.
![Page 9: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/9.jpg)
9
Outline
ه Introductionه Scalable Video Codingه Proposed Methodه Simulation Resultsه Conclusion
![Page 10: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/10.jpg)
10
Scalable Video Coding
ه The scalable extension to H.264/MPEG-4 AVC is considered as the state of the art for scalable video coding.
ه A video compressed using such technology is composed of one or several video layers. ه base layer ه enhancement layers
ى fidelityى spatialى temporal
![Page 11: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/11.jpg)
11
Scalable Video Coding
ه All the lower layers of the coded stream are required for decoding a video frame of a higher layer.
ه The more accumulated video layers that are received, the better the decoded video quality will be.
![Page 12: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/12.jpg)
12
Outline
ه Introductionه Scalable Video Codingه Proposed Methodه Simulation Resultsه Conclusion
![Page 13: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/13.jpg)
13
Layer-aligned Multi-priority Rateless Codes
ه The proposed method in this section for the unequal error protection of data with multiple prioritiesه protection strength can be varied for different portions of the
layered data.
ه An analytical model to predict the protection strength will be proposed thereafter.
![Page 14: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/14.jpg)
14
N-cycle Layer-aligned Overlapping Structure
ه For video streaming protected using generic rateless codes, compressed videos require division into sections.
G O P
![Page 15: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/15.jpg)
15
N-cycle Layer-aligned Overlapping Structure
![Page 16: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/16.jpg)
16
Layer-aligned Multi-priority Rateless Codes
ه Each of the desired coded blocks for each window is produced using the following procedure:1. Determine a degree d according to a pre-defined degree
distribution.2. Choose d message blocks from N different layers. The
probability of choosing a certain message block from video layer j is pj, where 1≤j≤N. Suppose that there are nj message blocks from layer j in each window, .
3. A coded block is formed from the result of an XOR operation on the chosen message blocks.
![Page 17: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/17.jpg)
17
Layer-aligned Multi-priority Rateless Codes
ه The protection strength on different layers can be controlled through the vector of favorable probabilities (p1, p2, …, pN).
ه Alternatively, a weighing vector (ω1, ω2, …, ωN) of layers is defined, where ωj is the probability to choose a random message block from video layer j.
![Page 18: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/18.jpg)
18
AND-OR Tree
![Page 19: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/19.jpg)
19
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The analytical model can be used to find a suitable vector of favorable probabilities for transmitting layered data.
ه The probability of an unsuccessful decoding is defined as the number of unrecovered message blocks divided by the number of message blocks in the same partition.
![Page 20: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/20.jpg)
20
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The coding paradigm of the layer-aligned multi-priority rateless codes can be treated as a bipartite graph G and form an AND-OR tree from it.
![Page 21: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/21.jpg)
21
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه For each window, there are k message blocks that are treated as OR-nodes in an AND-OR tree.
ه There are nj message blocks from layer j in each window
![Page 22: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/22.jpg)
22
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The objective of the analytical model is to derive the probability pi, j for the root node of an AND-OR tree GTi, j to be evaluated as 0 (false).
![Page 23: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/23.jpg)
23
Analytical Model for Layer-aligned Multi-priority Rateless Codes
![Page 24: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/24.jpg)
24
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه To derive the probability pi, j , the model first determine the probability qi for an AND-node at level i to be evaluated as 0.
![Page 25: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/25.jpg)
25
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The probability qi can be obtained by considering all combinations of possible degree distributions.
ه .
![Page 26: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/26.jpg)
26
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The probability pi, j for the OR-node from layer j at level i to be 0 is calculated by considering the scenario where all its child nodes are evaluated as 0.
![Page 27: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/27.jpg)
27
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The probability λm, j for an OR-node with degree m from layer j can then be expressed as
ه .
ه The probability Rm, j of an edge connecting to an OR-node with degree m from layer j is calculated as
ه .
![Page 28: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/28.jpg)
28
Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه Recall…ه The probability of unsuccessfully decoding every layer of the data
can then be calculated.
ه .
![Page 29: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/29.jpg)
29
Outline
ه Introductionه Scalable Video Codingه Proposed Methodه Simulation Resultsه Conclusion
![Page 30: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/30.jpg)
30
Simulation Results
ه In order to decompress a video frame of a certain layer of a video, all the lower layers of the same unit of the coded stream are required.
ه The decoded video quality improves as the number of accumulated video layers increases.
![Page 31: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/31.jpg)
31
Simulation Results
ه The resource distribution scheme will determine the vector of favorable probabilities (p1, p2, …, pN) which maximizes the number of expected decompressible frames.ه .
![Page 32: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/32.jpg)
32
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The first simulations are for dataه 2 layers (N=2), where n1:n2=3:7ه degree distribution used in Raptor codes [6] is applied.
ه The weighing vector (ω1, ω2) = (ω1, 1 - ω1), with different ω1 (0.05 to 0.95, with a step size=0.05) is simulated.
![Page 33: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/33.jpg)
33
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه Prediction error of the analytical model at k=2000.
![Page 34: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/34.jpg)
34
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه Prediction error of the analytical model at 11 sections.
![Page 35: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/35.jpg)
35
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The performance of the analytical model at 11 sections.
![Page 36: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/36.jpg)
36
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The performance of the analytical model at 21 sections.
![Page 37: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/37.jpg)
37
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The second simulations are for dataه 3 layers (N=3), where n1:n2:n3=1:1:2ه degree distribution used in Raptor codes is applied
ه The weighing vector (ω1, ω2, ω3) = (0.25, ω2, 0.75 - ω2), with different ω2 (0.05 to 0.7, with a step size=0.05) is simulated.
![Page 38: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/38.jpg)
38
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The performance of the analytical model at 3 layers, lower overhead.
![Page 39: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/39.jpg)
39
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The performance of the analytical model at 3 layers, higher overhead.
![Page 40: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/40.jpg)
40
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The third simulations are for dataه 2 layers (N=2) at different n1:n2 ratiosه Besides n1:n2=3:7, the experiments at 5:5 and 7:3 are conducted.
[22] D. Vukobratovic, V. Stankovic, D. Sejdinovic, L. Stankovic’, Z. Xiong, “Scalable video multicast using expanding window fountain codes,” IEEE Transactions on Multimedia, vol. 11, no. 6, pp. 1094–1104, Oct. 2009.
![Page 41: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/41.jpg)
41
Accuracy Analysis of the Analytical Model for Layer-aligned Multi-priority Rateless Codes
ه The performance of the proposed codes and the expanding window fountain codes. k=2000, 11 sections.
![Page 42: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/42.jpg)
42
Accuracy Analysis of the Model for the Expected Decompressible Video Frames
ه A video of soccer at 325x288 is compressed using the ه scalable extension of MPEG-4 AVCه 5 temporal layers without the protection of channel codingه GOP size = 16 framesه each key picture was encoded as an IDR pictureه packet size was 1500 bytes
![Page 43: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/43.jpg)
43
Accuracy Analysis of the Model for the Expected Decompressible Video Frames
ه The predicted decompressible frames in comparison with the actual decompressed frames.
![Page 44: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/44.jpg)
44
Performance Comparison of the Proposed Layer-aligned Multi-priority Rateless Codes
ه All four methods described above follow the degree distribution used in Raptor codes [6].
ه In this simulation, the video soccer at 325x288 is compressed into ه 2 video layersه compressed size of the first layer is about 1/3 of the total bit-rate. ه the number of message blocks k = 2033ه 1825 frames encoded using MPEG-4 AVC scalable extensionه GOP=16ه layer 1 = 2 frames and layer 2 = 14 frames
![Page 45: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/45.jpg)
45
Performance Comparison of the Proposed Layer-aligned Multi-priority Rateless Codes
ه Prediction performances of the analytical models: LMRC and RC-UEP.
![Page 46: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/46.jpg)
46
Performance Comparison of the Proposed Layer-aligned Multi-priority Rateless Codes
ه The number of decompressed video frames vs. the coding overhead using different codes.
![Page 47: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/47.jpg)
47
Performance Comparison of the Proposed Layer-aligned Multi-priority Rateless Codes
ه The received video quality in PSNR vs. the coding overhead using different codes.
![Page 48: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/48.jpg)
48
Outline
ه Introductionه Scalable Video Codingه Proposed Methodه Simulation Resultsه Conclusion
![Page 49: Layer-aligned Multi-priority Rateless Codes for Layered Video Streaming](https://reader033.vdocuments.net/reader033/viewer/2022061602/56816065550346895dcf8fa6/html5/thumbnails/49.jpg)
49
Conclusion
ه The analytical model was shown to achieve high prediction accuracy, compared to the other unequal error protection in the literatures.
ه The analytical model is accurate and the layer-aligned multi-priority rateless codes are suitable for layered streaming, especially when the section size is limited.