The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP

Hayder Radha ,Mihaela van der Schaar

and Yingwei Chen

IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001

Outline

Introduction SNR FGS Video Coding Method FGS Coding with Adaptive

Quantization Hybrid Temporal-SNR Scalability with

an All FGS Structure Conclusions

Introduction

Video-Coding and Networking Minimal real-time processing and rate

control when large number of unicast Highly adaptable to unpredictable

bandwidth Low-complexity decoding and low-

memory requirements

Introduction(2)

Able to support both multicast and unicast applications

Scalable bitstream must be resilient to packet loss events

SNR FGS Video Coding

[ Rmin = Rb , Rmax = Rb + Re ]

SNR FGS Video Coding(2)

SNR FGS Video Coding -encoder

Two encoders

base layer->motion compensation

enhancement layer->fine-granular Each DCT FGS-residual frame

consists of NBP bitplanes

SNR FGS Video Coding -scanning order

Architecture for the SNR FGS Video Coding -decoder

SNR FGS Video Coding -performance

Compared with traditional SNR scalability video coding

SNR FGS Video Coding -performance(2)

SNR FGS Video Coding -performance(3)

SNR FGS Video Coding -conclusions

FGS exploits temporal redundancy only at the base layer

FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content

SNR FGS Video Coding -conclusions

Base-layer could have a major impact on the overall performance of FGS

[R2,Rmax] could be significantly better than the average performance over the wider range[R1,Rmax]

FGS Coding with Adaptive Quantization

FGS-based AQ is achieved through bitplane shifting

Selected macroblocks within an FGS enhancement layer frame

Selected coefficients within the 8 * 8 blocks

Adaptive Quantization-Selective Enhancement

Adaptive Quantization-frequency weighting

Adaptive Quantization-combine SE with FW

Adaptive Quantization-notice

SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative

operation Up-shifting operation does not

guarantee that a particular SE macroblock gets scanned earlier(MSB)

Adaptive Quantization-evaluation

Not improve the rate-distortion performance ,but rather to improve the visual quality

SE can be used to enhance a particular region

FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails

Adaptive Quantization-evaluation(2)

Hybrid Temporal-SNR Scalability

Temporal scalability : Enhance the motion smoothness of compressed video

F = FBL + FEL

Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)

all-FGS hybrid temporal-SNR scalability structure

Architecture for the all-FGS hybrid temporal-SNR scalability encoder

Architecture for the all-FGS hybrid temporal-SNR scalability decoder

Performance Evaluation of the Hybrid FGS Scalability Method

Performance Evaluation of the Hybrid FGS Scalability Method

Conclusions

MPEG-4 FGS framework Supporting unicast and multicast

Internet video application Adaptive quantization Hybrid temporal-SNR scalability

method