multimedia mpeg-7
TRANSCRIPT
•1
MPEG-7STANDARDS[MULTIMEDIA CONTENT
DISCRIPTION INTERFACE]
PRESENTED BY:NILESH R. JAISWAR
INDEX
•2
MPEG-7 OVERVIEW
MAJOR FUNCTIONALITIES
DETAILED TECHNICAL DISCRIPTION
PROFILING
BEYOND VERSION -1
CONCLUSION
•3
MPEG-7:
•An international standard for descriptions and description systems
•Goal: To search, identify, filter and browse audiovisual content
•Image/Video Retrieval •Text-based Retrieval
•Content-based Retrieval
INTRODUCTION
•4
Why do we need MPEG-7 ?
N e e d
• Content Management
• Fast & Accurate Access
• Personalized Content Production and Consumption
• Automation
+
Support for Advanced Query
•Visual•Audio•Sketch
MPEG: A Brief History
•5
MPEG: Moving Picture Experts Group
ISO / IEC/JTC1/SC29/WG11
A Working Group of ISO/IEC in charge of the Development of Standards for
Coded Representation of Digital Audio and Video
Established in 1988
MPEG: A Brief History
•6
MPEG-1: Interactive CD and MP3 11 / 1992
MPEG-2: DTV, STB, DVD 11 / 1994
MPEG-4: Web and Mobility ver1: 09 /1998
ver2: 11 /1999
MPEG-7: ??? 09 / 2001
MPEG-21: Multimedia Framework 11 / 2001
MPEG-7: What Is It ?
•7
THE MPEG 7 THE MPEG 7 STANDARDSTANDARD THE MPEG 7 THE MPEG 7 STANDARDSTANDARD
Content Description of Various Audio Visual
Information
IS NOT a COMPRESSION Standardsimilar to MPEG-1/2/4 or their
Extension
IS NOT a STANDARD forFEATURE
EXTRACTION/MATCHING
Types of Audio Visual Information• Audio, Speech• Moving video, still pictures, graphics• Information on how objects are combined in scenes
Types of Audio Visual Information• Audio, Speech• Moving video, still pictures, graphics• Information on how objects are combined in scenes
MPEG-7: Application Areas
Storage and retrieval of audiovisual databases (image, film,
radio archives)
Broadcast media selection (radio, TV programs)E-commerce and Tele-shopping (searching for clothes / patterns)
Remote sensing (cartography, ecology, natural resources management)
Entertainment (searching for a game, for a karaoke)
Cultural services (museums, art galleries)
Journalism (searching for events, persons)
Intelligent multimedia presentationsEducational applications Bio-medical applications
MPEG-7: Main Elements
•9
Descriptors (D)
syntax and semantics of each feature representation
Description Schemes (DS)
structure and semantics of the relationships between
components
Description Definition Language (DDL)
creation of new DS’s
modification/extension of existing DS’s
MPEG-7: Major Functionalities
•10
Systems (ISO / IEC 15938 )
Description Definition Language (ISO / IEC 15938)
Visual (ISO / IEC 15938)
Audio (ISO / IEC 15938)
Multimedia Description Schemes (ISO / IEC 15938)
MPEG-7: Systems
•11
It defines tools to:
manage and protect intellectual property
Includes currently the binary format for encoding
synchronize between content and description
provide for efficient storage and transport
MPEG-7: DDL and its Components
•12
A language that allows the creation of new Description Schemes and, possibly, Descriptors.”
“It also allows the extension and modification of existing Description Schemes.”
Description Definition Language:It is based on XML Schema LanguageConsists of
XML Schema Structural ComponentsXML Schema Data TypesMPEG-7 Specific Extensions
MPEG-7: Audio
•13
Sound Effects• High-Level Audio Description Tools (Ds & DSs)
•Instrumental timbre description tools
•Sound recognition tools
•Spoken content description tools
•Melody description tools (facilitate query-by- humming)
MPEG-7: Visual
•14
Consist of basic structures and description
Color
quantization, dominant, scalable, color-structure, layout,
GoF/GoP
Texture
Shape
region-based, contour-based, 3D
Motion
camera motion, motion trajectory, parametric motion,
motion activity
DETAILED TECHNICAL DISCRIPTION
Visual Descriptors
It describe tools included in the std consist of basic structure & descriptor that covers the feature like-
Color DescriptorsTexture DescriptorsShape DescriptorsMotion Descriptors for Video
Basic Visual Structures
•16
Grid Layout
2D-3D Multiple View
Time Series
Spatial 2D Coordinates
Temporal Interpolation
Color Descriptors
Color SpacesIn this description following color space are supported-RGB, YCrCb, HSV, MONOCHROME etc.
Color LAYOUTIt effectively represent the spatial description of color of visual signals in a very compact form. It Clusters the image into 64 (8x8) blocks
Color structureIt is a color feature descriptor that captures both color content & information about the structure of this content.
Texture DescriptorsHomogenous Texture DescriptorNon-Homogenous Texture Descriptor (Edge Histogram &
Texture)
Homogenous texture
It has emerged as an important visual primitive for searching & browsing through large collection of similar looking pattern.
The computation of this descriptor is based on filtering using scale and orientation selective kernels.
Non-Homogenous Texture
It is useful for representing homogenous texture for browsing type application & requires only 12 bit (max).
It provide perceptual characteristic of texture similar to human characterization in terms of regularity, coarseness & directionality.
Represents the spatial distribution of five types of edges.
Dividing the image into 16 (4x4) blocks.Generating a 5-bin histogram for each block.It is scale invariant.
Shape DescriptorsRegion-based Descriptor
Contour-based Shape Descriptor
2D/3D Shape Descriptor
Region-based DescriptorThe shape of an object may consist of either a single
region or a set of region as well as some holes in the object.
Advantages:Describes complex shapes with disconnected
regions.Robust to segmentation noise.Small size , Fast extraction and matching.
Contour-Based Descriptor
The contour shape descriptor captures characteristic shape feature of an object or region based on its contour.
It uses so called curvature scale-space representation, which captures perceptually meaningful features of the shape.
•24
AUDIO
MPEG-7 audio provide stuctures bulding upon some basic structures from the MDS for discribing audio content.
1.AUDIO FRAMEWORK• It contains low level tools designed to provide a basis for the construction of higher level audio application.• By providing a common platform for the structure of description & the basic semantics for commonly regarded audio feature.
•25
PROFILING
•Similar to all MPEG Standards profiling of the tools specified in the standard will play an important role to allow deployment of MPEG-7 technology with reasonable costs & complexity.
•A profile is a set of functionality for one or more classes of application.
•The keyword to define profile is functionality.
•26
Mpeg-7 terminal•MPEG-7 system provide the means to represent coded multimedia content description .•The entity that makes use of such coded representation of the multimedia content description is generally referred as the ISO/IEC 15938 terminal or ‘MPEG-7 terminal’.
conformance testing•It includes the guideline & procedures for testing conformance of MPEG-7 implementation both for description & terminals.
•27
CONCLUSION MPEG-7 is advance version. It is better than below versions of MPEG. Because, It includes new audio , video tools. It is not aimed at any one application in particular rather the elements that standardizes support as broad a range of applications as possible.
•GROUP MEMBERS:
1.SAGAR NIKAM 2. NILESH JAISWAR
•GUIDE:M/S PRADNYA VARTAK