Description of some multimedia ontologies

Raphael.Troncy@cwi.nl

Raphaël Troncy

Thursday 1st of December, 2005

Multimedia OntologiesMultimedia ontologies can be related to

many works, standards, communities …Focus here on MPEG-7 ... as a whole

ISO Standard composed of 11 parts but it is still growing …

DDL = XML Schema + small extensionsDescriptors and Description Schemes

1182 elements, 417 attributes, 377 complex types in the schema (MDS + Visual + Audio parts)

40 Classification Schemes

Agenda

DSTC's ProposalJane Hunter & Suzanne Little (ABC model)

TUC's ProposalChrisa Tsinaraki (DELOS)

INA's ProposalAntoine Isaac & Raphaël Troncy

DMAG/MTG's ProposalRoberto Garcia & Oscar Celma

DSTC's Proposal (summary)1st proposal chronologically

MPEG-7 ontology developed in RDFS, then converted into DAML+OIL and now OWL

Contains 60 classes and 40 propertiesOWL Full ontology

Cover the upper level of the MDSsegments and decompositionagent, role, place, time and instrumentbasic visual descriptors

Available at: http://maenad.dstc.edu.au/slittle/mpeg7.owl

TUC's ProposalSoftware Engineering Framework

aiming to facilitate Knowledge-based MPEG-7 Multimedia Application Development Being developed in TUC/MUSIC

Consists of:An Ontological InfrastructureMethodologies for Interoperability between

MPEG-7 and OWLAn underlying MPEG-7 RepositoryTools implementing the DS-MIRF approach

DS-MIRF Ontological Infrastructure

OWL Application Ontologies

Fully captures the MPEG-7 MDS

...

...

OWL Upper Ontology

“Fill the blanks” left from the MPEG-7

MDS for Application Support

Typed Relationships

Semantic User Preferences

Application Ontology X

...

OWL Domain Ontologies

Extend the Upper Ontology and the Application Ontologies with

Domain Knowledge

Soccer Domain Ontology

F1 Domain Ontology

Domain Ontology X

...

DS-MIRF Ontological InfrastructureAn Upper Ontology that fully

captures the MPEG-7 MDS and a part of the MPEG-7 VisualBeing extended to capture the MPEG-21

DIA ArchitectureTransformation Rules to transform

OWL Ontologies and OWL/RDF metadata into MPEG-7 documentsImplemented in the GraphOnto Ontology

and Metadata Editor

TUC's Ontology Definition Methodology Manual definition based on the following rules:

MPEG-7 Simple Datatype Representation: Integration of the XML Schema simple datatypes (rdfs:Datatype)

MPEG-7 Complex Type Representation: Homonym OWL ClassesAttributes & Simple Type Elements: Datatype PropertiesComplex Type Elements: Object PropertiesSubclassing:

Simple Types: Datatype property with rdf:ID “type_nameContent” – where type_name is the type of the supertype

Complex Types: rdfs:subclassOfConstraints: OWL Restrictions

MPEG-7 Classification Scheme Representation: Individuals of the MDS type “ClassificationSchemeType”

TUC's Proposal (summary)Cover the full standard

Contains 420 classes and 175 properties for the MDS part

OWL DLCover also the CSs

The 40 CSs have been translated into simple OWL hierarchy

Available at: http://elikonas.ced.tuc.gr/ontologies/av_semantics.zip

INA's Proposal Different uses of AV Document Descriptions

Archival and description of documents from a cultural heritage point of view: INA

Exchanging program identification and characterization for interactive TV: TV-Anytime

Diffusion of program information (news agencies): ProgramGuideML

Storing and sharing AV content descriptions (automatic extraction results): MPEG-7 standard

Can we find an AV core ontology?

There are many common needs amongst observed applicationsCharacterization of programs and sequencesDecomposition of programs and sequencesAbility to introduce description of the

activities that constitute the context of AV documents (roles of people involved, ways production and broadcast are achieved)

These concepts are close to a "neutral" archival viewpoint

C.O. content

Concerning AV objects:distinction sequence/programdecomposition and qualification of those objectslink to external world themes and entities (content

description)

Underlying use patterns for elicited categories

Theme-relatedEntities

Channel, Live,Daily...

ProgrambroadcastRelation[hasBroadcaster,hasPeriodicity...]

thematicRelation[hasTheme, shows,

refersTo...]

Sequence

partOf

partOf

Productor, Zoom...productionRelation

[hasAuthor,hasFilmingFeature...]

Example:

Upper-level categorization of sequences

Example:Upper-level categorization of program

INA's Proposal (summary) Cover the MDS upper part, and partially

the audio and visual partsContains 610 classesOWL DL

Cover also (partially) the CSsadapted to TV Anytime (and

ProgramGuideML)adapted to INA's needs

Linked to the DOLCE ontology Available at: http://www.cwi.nl/~troncy

/MPEG-7/

DMAG/MTG's Proposal

Reuse MPEG-7 implicit semantics.XML Semantic Web:

XSD2OWL: schema to ontology.XML2RDF: XML instance data to RDF

instances.Tested as integration base for:

MusicBrainz, Simac, Music Vocabulary, etc.

XMLSchema to OWL Mappings

sequencechoice

@maxOccurs@minOccurs

extension@base|restriction@base

complexType//element

complexType|group|attributeGroup

element@type

element@substitutionGroup

element|attribute

XML Schema

owl:intersectionOfowl:unionOf

owl:maxCardinalityowl:minCardinality

rdfs:subClassOf

owl:Restriction

owl:Class

rdfs:range

rdfs:subPropertyOf

rdf:Propertyowl:DatatypePropertyowl:ObjectProperty

OWL

DMAG/MTG's Proposal (summary)

Cover the whole MPEG-7 + the upper level of the Classification SchemesContains 2372 classes and 975 propertiesOWL Full

Available at: http://dmag.upf.edu/ontologies/mpeg7ontos/

Questions ?

Towards an harmonization of these multimedia ontologies

Raphael.Troncy@cwi.nl

Raphaël Troncy

Thursday 1st of December, 2005

Preliminary resultsCurrent state:

Proposals are made individually, for specific research project

The OWL files contains some errorsCorrected versions available for DSTC and

DMAG/MTG ontologies

Different conceptualizations have been obtained … even if they start from the same MPEG-7 schema

No MPEG-7 endorsement

(Personal) Idea: Three step processAligning pair-wise ontologies

Visual part of aceMedia vs DMAG vs TUCMDS part of Hunter vs DMAG vs TUC vs INACSs part of DMAG vs TUC vs INA

Merging and fusingRe-engineering (manually) !

Current proposals are based on automatic translation rules from XSD to OWL (except INA)

Does NOT go beyond what XML Schema can express

Open Issues OWL DL vs OWL Full Real modularization of MPEG-7

upper part, visual, audio, CSsrequires breaking some existing

relationships ! Do we have to capture all MPEG-7 ?

people, agent, role, place are not multimedia-specific

Are there more multimedia ontologies currently developed ?Proton: http://proton.semanticweb.org/Boemie: re-use the aceMedia ontologies (MDO, VDO)

Questions ?