a concealment method for shape information in mpeg-4 coded video sequences shahram shirani, berna...

14
A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouz i Kossentini IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 2, NO. 3, SEPTEMPER 2000

Post on 22-Dec-2015

222 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences

Shahram Shirani, Berna Erol, and Faouzi KossentiniIEEE TRANSACTIONS ON MULTIMEDIA, VOL. 2, NO. 3, SEPTEMPER 2000

Page 2: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Outline

introduction MPEG-4: video compression and error

resilience concealment of channel errors in

MPEG-4 coded video proposed method experimental results

Page 3: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Introduction

Page 4: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

MPEG-4 : Video Compression and Error Resilience

MPEG-4 offers error resilience tools:– video packetization– data partition– reversible VLC

Page 5: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

MPEG-4 : Error Resilience

video packetization– The macroblock data between two resynchronization

markers is referred to as a video packet. data partition I-VOPs P-VOPs

reversible VLC

Page 6: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Concealment of Channel Errors in MPEG-4 Coded Video Data

P-VOPs

I-VOPs

Page 7: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Proposed method

Page 8: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Proposed method

The boundary transform:– if all the four neighboring pixels of a pixel are inside the

shape, then the pixel is declared inside. Otherwise, the pixel is assigned to the border of the shape.

Page 9: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Experimental Results

The similarity of the erroneous and error concealed shape data to the original shape data is measures using the following ratio:

– nd : the number of pixels that are different between the restored shape and the original one

– nt : the total number of pixels in the bounding box

Page 10: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Experimental Results (AKIYO)

272x208 30% missing

88%

99% (Mp-Mm)/M

= 17%

Page 11: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Experimental Results (BREAM)

144x192 29% missing

81%

(Mp-Mm)/M

98% = 22%

Page 12: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Experimental Results (BREAM)

272x192

25% missing

86%

99%

Page 13: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Experimental Results (WEATHER)

160x224

35% missing

87%

99%

Page 14: A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences Shahram Shirani, Berna Erol, and Faouzi Kossentini IEEE TRANSACTIONS ON MULTIMEDIA,

Conclusions

The paper presents an error concealment method for shape information in the MPEG-4 coded video sequences.

The proposed concealment method successfully reconstructs the missing shape data providing about 20% improvement compared to median filtering method.

Reasonable computational complexity of our algorithm makes it suitable for real-time application.