COMPARATIVE STUDY OF HEVC and H.264 INTRA FRAME CODING AND JPEG2000

BY Under the Guidance of Harshdeep Brahmasury Jain Dr. K. R. RAO

ID 1000845657MS Electrical Engineering

Multimedia Project proposal

EE 5359

Objective• In this project, the comparison of HEVC intra frame

coding with H.264 and JPEG2000 is analyzed and implemented.

1. Detailed analysis of HEVC Intra Frame coding only with H.264 Intra Frame coding only and JPEG 2000.

2. Comparison between HEVC, H.264 and JPEG 2000 by various comparison metrics.

3. MSE, PSNR and SSIM metrics are used as comparison metrics.

Introduction

• High efficiency video coding (HEVC) [1] standard is the most recent joint video project of the ITU-T video coding experts group (VCEG) and the ISO/IEC moving picture experts group (MPEG) standardization organizations,working together in a partnership known as the joint collaborative team on video coding (JCT-VC).

• It has many advantages over previous coding standards H.264 [4] and H.261 [4], like significant rate distortion efficiency achieving higher bit rate reduction, error resilience and is most network friendly compared to other standards.

VIDEO COMPRESSION STANDARDSSTANDARD SOFTWARE

MAIN APPLICATION YEAR

JPEG2000 JasPer [8] IMAGE 2000

H.264/MPEG-4 part 10

JM software [10] ADVANCED VIDEO CODING

2003

HEVC HM Software [11] ADVANCED VIDEO CODING

2013

JPEG2000 ENCODER AND DECODER

ENCODER[15]

ENCODER and DECODER[12]

JPEG2000• Extensions are .jp2, .j2k, .jpf, .jpx, .jpm,.mj2• Relies on wavelet transform• Another difference, in comparison with JPEG, is in

terms of visual artifacts JPEG 2000 produces ringing artifacts. The coded bit stream obtained after compression of an image with JPEG 2000 is scalable in nature, meaning that it can be decoded in a number of ways; for instance, by truncating the coded bit stream at any point.

Encoder [4]

H.264 BLOCK DIAGRAM

H.264 DECODER BLOCK DIAGRAM [15]

H.264/MPEG-4 AVC

H.264/MPEG-4 AVC is a block-oriented motion-compensation-based codec standard developed by the ITU-T Video Coding Experts Group (VCEG) together with the ISO/IEC Moving Picture Experts Group (MPEG)

Provides good video quality at substantially lower bit rates than previous standards.

H.264 is used in such applications as players for blu-ray discs, videos from youtube [24] and the iTunes Store, web software such as Adobe Flash Player and Microsoft Silverlight [24].

Encoder-Decoder of HEVC

HEVC video encoder (with decoder modeling elements shaded in light gray)[1].

High efficiency Video Coding• Reduces bitrate requirements by half with

comparable image quality, at the expense of increased computational complexity.

• Depending on the application requirements HEVC encoders can trade off computational complexity, compression rate, robustness to errors, and encoding delay time.

• Two of the key features where HEVC was improved compared to H.264/MPEG-4 AVC was support for higher resolution video and improved parallel processing methods.

Image Quality Measures

Criteria to evaluate the compression qualityTwo types of quality measures Objective quality measure- PSNR, MSE Structural quality measure- SSIMMSE and PSNR for a NxM pixel image are defined as

(1)

(2) dB

where x is the original image and y is the reconstructed image. M and N are the width and height of an image and ‘L’ is the maximum pixel value in the NxM pixel image.

M

m

N

n

nmynmxNM

MSE1 1

2,,*1

MSELPSNR2

10log10

Structural Similarity Method[SSIM] [1]

• SSIM emphasizes that the human visual system is highly adapted to extract structural information from visual scenes. Therefore, structural similarity measurement should provide a good approximation to perceptual image quality.

• The SSIM index is defined as a product of luminance (l), contrast (c) and structural (s) comparison functions.

• where , α>0, β>0 and γ >0 are parameters used to adjust

the relative importance of the three components

•

• where μ is the mean intensity, and σ is the standard deviation as a round estimate of the signal contrast. C1 and C2 are constants. M is the number of samples in the quality map.

[2]

[3]

REFERENCES: [1] G.J . Sullivan, J .R.Ohm,W.J .Han and T.Wiegand,” Overview of the high efficiency

video coding (HEVC) standard”, IEEE Trans. circuits and systems for video technology, vol. 22, no.12, pp. 1649 – 1668, Dec 2012.

[2] AIC website: http://www.bilsen.com/aic/. [3] T. Wiegand, G. Sullivan, G. Bjontegaard and A. Luthra, “Overview of the

H.264/AVC video coding standard”, IEEE Trans.circuits and systems for video technology, vol. 13, no.7, pp.560-576, July 2003.

[4] I. Richardson, “H.264 and MPEG-4 video compression: video coding for next generation multimedia”, Wiley 2ndedition, Aug. 2010.

[5] P. Topiwala, T. Tran and W.Dai, “Performance comparison of JPEG2000 and H.264/AVC high profile intra-frame coding on HD video sequences,” SPIE int’l symposium, digital image processing, vol. 6312, no.8, pp. 63120-63135, Aug. 2006.

[7] G. K. Wallace, “The JPEG still picture compression standard,” Communication of the ACM, vol. 34, no.4, pp. 31-44, April 1991.

[8] JPEG2000 latest reference software (jasper version 1.900.0) Website: http://www.ece.uvic.ca/~mdadams/jasper/

[9] H.264/AVC reference software (JM 18.2) Website: http://iphome.hhi.de/suehring/tml/download

[10] JM reference software, fraunhofer institute for telecommunications heinrich hertz institute. http://iphome.hhi.de/suehring/tml/.

[11] HM reference software, fraunhofer institute for telecommunications Heinrich hertz institute.http://hevc.hhi.fraunhofer.de/.

[12] JPEG2000 encoder and decoder block diagrams: http://eeweb.poly.edu/~yao/EE3414/JPEG.pdf [13] Microsoft HD photo specification: http://www.microsoft.com/whdc/xps/wmphotoeula.mspx [14] F. Bossen, B.Bross, K.S.Uhring and D. Flynn,” HEVC complexity and

implementation analysis”, IEEE Trans. on circuits and systems for video technology, vol.22, no.12, pp.1685-1696, Dec. 2012.

[15] H.264 decoder block diagram: http://www.allgosystems.com/html/h264_arm11.htm [16] P. Topiwala, “Comparative study of JPEG2000 and H.264/AVC frext i-frame

coding on high definition video sequences,” SPIE int’l symposium, digital image processing, vol. 5909, no.8, pp.10-17, Aug. 2005.

[17] A.Skodras, C. Christopoulos and T. Ebrahimi, “The JPEG 2000 still image compression standard”, IEEE signal processing, vol.18, no.1, pp.36-58, Jan. 2002. [18] YUV test video sequences: ftp://ftp.tnt.uni-hannover.de/testsequences [19] Q.Cai, L.Song and G.Li and N.Ling, “Lossy and lossless intra coding performance

evaluation: HEVC, H.264/AVC, JPEG 2000 and JPEG LS”. IEEE signal processing, vol.9, no.12, pp.1-9, Dec.2012.

[20] J .R.Ohm, G.J .Sullivan, H.Schwarz,T.K.Tan and T.Wiegand,” Comparison of the coding efficiency of video coding standards – including high efficiency video coding (HEVC)”, IEEE Trans. on circuits and systems for video technology, vol.22, no.12, pp.1669-1684, Dec. 2012.

[21] M.T.Pourazad, C.Doutre, M.Azimi, and P.Nasiopoulos,”HEVC:The new gold standard for video compression”, IEEE consumer electronics magazine ,vol.1, no.7, pp.36-46, July 2012.

[22] Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,”IEEE Trans. on image processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.

[23] A. G. Solanki” Implementation and performance analysis of H.264 intra frame coding, JPEG, JPEG-LS, JPEG-2000 and JPEG-XR” EE5359, UTA, Spring 2012.

http://www-ee.uta.edu/Dip/Courses/EE5359/index.html. [24] S. Subbarayappa” Comparitive study of H.264 intra frame coding, JPEG, JPEG-LS,

JPEG 2000 and JPEG XR” EE5359, UTA, Fall 2010. http://www-ee.uta.edu/Dip/Courses/EE5359/index.html.