towards affective-physiological foundations for music production

António Pedro OliveiraAntónio Pedro OliveiraUniversity of Coimbra, University of Coimbra,

PortugalPortugal12/09/200712/09/2007

Towards Affective-PsychophysiologicalFoundations for Music Production

05/03/23 António Pedro Oliveira 2

OutlineOutline Introduction Introduction

Background

MethodologyMethodology

Emotions representationEmotions representation

Affective Music Knowledge BaseAffective Music Knowledge Base

Music manipulationMusic manipulation

Emotional output validationEmotional output validation

ConclusionConclusion


IntroductionIntroduction

BackgroundBackground Music Psychology

Understand perception, cognition and experiencing of music

Computer Music Use computer in the analysis and production of

music

Affective Computing Use of devices to process (recognize, simulate and

express) emotions


IntroductionIntroduction

Types of affect (Scherer 2000)Types of affect (Scherer 2000)


Emotions representationEmotions representation

2 Dimensional and Lexical 2 Dimensional and Lexical spacespace


Affective Music Knowledge Affective Music Knowledge BaseBase

Relations between musical Relations between musical features and arousal and features and arousal and valence of emotionsvalence of emotions


Affective MusicAffective Music

Match relations of the knowledge Match relations of the knowledge base with the emotional description base with the emotional description (e.g., high valence)(e.g., high valence)

Select music from the music base Select music from the music base according to matched relationsaccording to matched relations


Sequence and transform Sequence and transform selected musicselected music

Produce a set of musical Produce a set of musical segments that sound fluentsegments that sound fluent


Perceived and induced Perceived and induced emotionsemotions

Use of psychophysiological Use of psychophysiological measures to detect perceived measures to detect perceived and induced emotionsand induced emotions

Electromyography



Electrocardiogram

Respiration



Skin conductance


Perceived and induced Perceived and induced emotions emotions

Relations of emotionsRelations of emotions Sadness, fear and happiness

with psychophysiological measureswith psychophysiological measures Heart rate, blood pressure, skin conductance,

temperature, etc.


Emotional output validationEmotional output validation

Assessment methodologyAssessment methodology Use emotional descriptions to select and

manipulate music with appropriate musical features

Play an emotional playlist Identify emotions through the analysis of

psychophysiological and self-report measures


ConclusionConclusion

Design a computational model of music production grounded on affective and psychophysiological foundations

Validate the model with users to promote a reliable expression and induction of emotions by using music

System can be applied in areas that intend to produce music given an emotional input

Music Therapy, soundtracks for arts, movies, dance, theater, virtual environments, computer games, etc.

towards affective-physiological foundations for music production

Engineering