file format for scalable video coding outline
DESCRIPTION
File Format for Scalable Video Coding Outline. SVC Introduction Review of File Format Basics SVC File Format Examples of Use. CMPT 820 – 2008 Summer Presented by Jeff Jiang. File Format for Scalable Video Coding SVC Introduction. SVC Scalabilities and the Cube Model - PowerPoint PPT PresentationTRANSCRIPT
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction
SVC Scalabilities and the Cube Model
Bit-Stream Representation
Usage and Application Scenarios
SVC High-Level Syntax
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Scalability & Data Model
SVC Scalabilities and the Cube Model
Temporal, Spatial, and SNR (Fidelity/Quality) scalability
Cube data model
SVC Syntax Elements – PDTQ Priority-id Dependency_id Temporal_id Quality_id
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Bit-Stream Representation
• Flexible Combined Scalability
• Layered Scalability
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – Usage and Application
• Direct File Access• Adaptation Operation
• Erosion Storage - Surveillance
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC Introduction – SVC High-Level Syntax
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
• The file structure is object-oriented and can be decomposed into
its constituent objects easily
• The files have
• Logical structure – a set of time parallel tracks, “movie”
• Time structure – sequence samples in time
• Physical structure – separate logical and time structure data from media data
themselves
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
• Tracks alternative to each other – using the same nonzero alternate group
number
• Special samples:
• Synchronization point ( I-frame)
• Track sample dependency
• Sample groups – used in SVC file format
• File type box
• The specifications to which the file complies
• Permission for a reader
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – ISO Base Media File Format
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
File Format Review – AVC File Format
A sequence of access unit, each divided into a number of NAL units
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Design Principles
• Extractor – Extract subsets that will be often extracted
easily
• Grouped into tiers which contain one or more
scalability layers (Sample groups)
• Have time-parallel data (Time parallel metadata track)
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Extractor Tracks
Allow “Cookbook” construction, take the forms of tracks within the alternate group
3 different ways to represent subset
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Extractor Tracks ‘Continue
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Sample Groups
• Using sample groups• Structure of sample groups
• A number of sets of description tables• A number of mapping tables
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Metadata
• Structured as a sequence of file format samples, just
like a video track
• Each metadata sample is structured as a metadata
statement
• Empty statement
• Group of statements
• Sequence of statements
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – Metadata ‘Continue
some statement about the whole samplesequenceOfStatements { empty statement about SEI NALu groupOfStatements: { NALu header 1 statement; some other statement about NALu 1 } groupOfStatements { aggregator statement sequenceOfStatements { NALu header 2.1 statement; groupOfStatements: { NALu header 2.2 statement another statement about NALu 2.2 } } } some statement about NALu 3}
SEI NALuBase-layer Slice NALu 1aggregator NALu 2 containing { enhancement NALu 2.1, enhancement NALu 2.2}another enhancement NALu 3
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
SVC File Format – AVC Compatibility
• AVC compatibility can be divided into two major areas:
• File Format Compatibility
• Video coding compatibility
• Sample-entry name used by SVC track
• Avc1 – Define for AVC, use no data extraction, fully back-ward compatible
• Avc2 – use data extraction
• Svc1 – No AVC compatible
• It is recommended to store AVC base layer in a separated AVC base track.
SVC enhancement layer data reference the AVC base track
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Outline
I. SVC Introduction
II. Review of File Format Basics
III.SVC File Format
IV.Examples of Use
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example I – Simple Extractor Tracks
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example II – Base Track
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example III – Aggregator Uasge
• Including NAL units in an aggregator
• Referencing NAL units by an aggregator
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
Tiers Tier T0: H.264/AVC base layer (QCIF at 15 fps). Tier T1: spatial enhancement of T0 to CIF. Tier T2: temporal enhancement of T1 to 30 fps. Tier T3: spatial enhancement of T2 to 4CIF (including the MGS
enhancement). Groups
Group G0 Tier T0, primary definition; Group G1 Tier T0, tier IDR; Group G2 Tier T1, primary definition; Group G3 Tier T1, tier IDR; Group G4 Tier T2, primary definition; Group G5 Tier T3, primary definition; Group G6 Tier T3, tier IDR.
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Example IV – Reading Map and Group Information
Maps Map M0: G1, G3, G3, G6, G6, G5, G5 (as in sample 0); Map M1: G0, G2, G5, G5 (as in samples 1 and 2); Map M2: G4, G5, G5 (as in samples 3 and 4).
Samples Sample 0: M0; Sample 1: M1; Sample 2: M1; Sample 3: M2; Sample 4: M2.
CMPT 820 – 2008 Summer Presented by Jeff Jiang
File Format for Scalable Video Coding
Summary
• The SVC File Format defines techniques to describe operation
points and the resulting grouping of bit stream elements
• It describes the bit stream structure and the dependencies exited
between bit stream elements
• Defines 3 types of scalability assisance
• Precomputed scalability assistance
• Scalability assistance through tiers (mainly assistance for layered
scalability)
• Scalability assistance with parallel metadata
CMPT 820 – 2008 Summer Presented by Jeff Jiang