ontological description of indian art music for knowledge ... · suddha gandhara sadharana gandhara...

1
Ontological description of Indian art music for knowledge-driven exploration of audio music collections Gopala Krishna Koduri, Xavier Serra {gopala.koduri, xavier.serra}@upf.edu Audio Database Audio Features Editorial Information Semantic Information Music Scores Application Programming Interface (API) Client Web Server Linked Data Linking Open Data Presentation Layer Web/Mobile Browser Data Sources Processing Layer Data Processing Audio mid- and high-level descriptors Semantic descriptors Information Processing Ontology Denition Data Linking Similarity measures Analysis of melodic and rhythmic aspects of music taking advantage of the domain knowledge obtained from musicological texts and from experts: http://compmusic.upf.edu/node/4 Knowledge-based similarity measures to navigate and explore the music collections using musically aware connections between entities [1]. System overview & goals Ontologies for concepts and relationships coming from music theory [2]. Audio music collections with metadata and contextual information as complete as possible, linked to other sources: http://musicbrainz.org/user/compmusic/collections Requirements Ontologies for Indian art music Raaga Progression Svara Sequence Gamaka hasSequence hasProgression hasSvara hasGamaka hasSvara isA isA OWLList isA hasRendition so:Segment tl:Interval isA Shadjama Rishaba Gandhara Madhyama Panchama Dhaivata Nishada Suddha Gandhara Sadharana Gandhara Antara Gandhara Chatussruti Rishaba ..... Suddha Rishaba isA isA isA isA isA isA isA isA isA isA isA precedes disjointWith disjointWith disjointWith isA Partial rāga ontology [2] Three important aspects which need intologies for a complete description of Indian art music: Rāga (melodic framework), Tāla (rhythmic framework) and Forms (compositional and improvisatory categories). Challenges relevant to most, if not all music traditions, such as melodic sequences, are modeled with appropriate semantics. Used in conjuction with audio data analyses with mutual benefit. Used in linking multiple sources of information. Used to directly compute the relatedness/similarity measures between musical entities. [1] Porter, A., Sordo, M., Serra, X.: Dunya: a system to browse audio music collections using cultural context. In: ISMIR. (2013) In press [2] Koduri, G. K., Serra, X.: A knowledge-based approach to computational analysis of melody in Indian art music, In: SMAM-ISWC. (2013) In press Example queries 1. Which svaras are the most distinguishing ones between Tōi and Śankarābharaa?. 2. List out the differences between phraseology for Kayāi rāga in compositions of Tyāgarāja and Dīkitar 3. Which rāgas are similar to Bahudāri?

Upload: others

Post on 19-May-2020

15 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ontological description of Indian art music for knowledge ... · Suddha Gandhara Sadharana Gandhara Antara Gandhara Chatussruti Rishaba..... Suddha Rishaba isA isA isA isA isA isA

Ontological description of Indian art music for knowledge-driven exploration of audio music collections

Gopala Krishna Koduri, Xavier Serra{gopala.koduri, xavier.serra}@upf.edu

AudioDatabase

AudioFeatures

EditorialInformation

SemanticInformation

MusicScores

Application Programming Interface (API)

Client

Web Server

Linked Data

Linking Open Data

Presentation Layer

Web/Mobile Browser

Data Sources

Processing Layer

Data ProcessingAudio mid- and

high-level descriptorsSemantic descriptors

Information Processing

Ontology Definition

Data Linking Similarity measures

Analysis of melodic and rhythmic aspects of music taking advantage of the domain knowledge obtained from musicological texts and from experts:http://compmusic.upf.edu/node/4

Knowledge-based similarity measures to navigate and explore the music collections using musically aware connections between entities [1].

System overview & goals

Ontologies for concepts and relationships coming from music theory [2].

Audio music collections with metadata and contextual information as complete as possible, linked to other sources:http://musicbrainz.org/user/compmusic/collections

Requirements

Ontologies for Indian art music

Raaga

Progression

Svara

Sequence

Gamaka

hasSequence

hasProgression

hasSvara

hasGamaka

hasSvaraisA

isA

OWLListisA

hasRendition

so:Segment tl:IntervalisA

Shadjama

Rishaba

GandharaMadhyamaPanchama

Dhaivata

Nishada

SuddhaGandhara

SadharanaGandhara

AntaraGandhara

ChatussrutiRishaba

.....

SuddhaRishaba

isA

isA

isA

isAisA

isA

isA

isA

isA

isAisA

precedes

disjointWith

disjointWith

disjointWithisA

Partial rāga ontology [2]

Three important aspects which need intologies for a complete description of Indian art music: Rāga (melodic framework), Tāla (rhythmic framework) and Forms (compositional and improvisatory categories).

Challenges relevant to most, if not all music traditions, such as melodic sequences, are modeled with appropriate semantics.

Used in conjuction with audio data analyses with mutual benefit.

Used in linking multiple sources of information.

Used to directly compute the relatedness/similarity measures between musical entities.

[1] Porter, A., Sordo, M., Serra, X.: Dunya: a system to browse audio music collections using cultural context. In: ISMIR. (2013) In press[2] Koduri, G. K., Serra, X.: A knowledge-based approach to computational analysis of melody in Indian art music, In: SMAM-ISWC. (2013) In press

Example queries

1. Which svaras are the most distinguishing ones between Tōḍi and Śankarābharaṇaṁ?.2. List out the differences between phraseology for Kaḷyāṇi rāga in compositions of Tyāgarāja and Dīkṣitar3. Which rāgas are similar to Bahudāri?