virtual instrument design and animation cynthia bruyns robert taylor carlo séquin
DESCRIPTION
Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin University of California at Berkeley. Aim. To provide an environment for evaluating the sound qualities of modeled simple idiophones. Images courtesy of Steve Reinmuth. Aim. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/1.jpg)
Virtual Instrument Design and Animation
Cynthia BruynsRobert TaylorCarlo Séquin
University of California at Berkeley
![Page 2: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/2.jpg)
AimAim
To provide an environment for evaluating the
sound qualities of modeled simple idiophones
Images courtesy of Steve Reinmuth
![Page 3: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/3.jpg)
AimAim
To recreate the object’s sound in an interactive environment
To be able to use these sounds to extend synthesis for computer music
Modeled Objects Mode Activation
![Page 4: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/4.jpg)
Previous Sound Generation ResearchPrevious Sound Generation Research
StochasticSerra, X. et al. 1990
Cook, P. 2001
Texturesvan den Doel, K. et al.
2001
Di Fillipo, D. et al. 2000
AnalyticSmith, J. 1992
Cook, P. 1995
ModalMorrison, J. et al. 1993
O’Brien, J. et al. 2001
Methods for sound synthesis for graphics
![Page 5: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/5.jpg)
Geometric ModelsGeometric Models
Simple or complex shapes
Multiple resolutions are generated
Can use thin or solid models
![Page 6: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/6.jpg)
Physical ModelPhysical Model
![Page 7: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/7.jpg)
Modal FormulationModal Formulation
![Page 8: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/8.jpg)
Mode Shapes (exaggerated)Mode Shapes (exaggerated)
![Page 9: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/9.jpg)
Modal ActivationModal Activation
Load model geometry into viewer program. Choose materials parameters. Select several strike locations on the model
– and map to keys of a midi keyboard.
PLAY ! – Key velocity determines intensity of strike.
![Page 10: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/10.jpg)
Interactive Sound GenerationInteractive Sound Generation
Software created as an Audio Unit plug-in
Can be used in AU host applications
This allows for sound generation in a composing environment
Strike Location
![Page 11: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/11.jpg)
Sound ValidationSound Validation
Synthesized sounds were compared with actual object sound generation Square plate
Aluminum
Steel
Rectangular plate
Aluminum
Odd shaped plates
Aluminum Model Real
![Page 12: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/12.jpg)
Measurement SetupMeasurement Setup
Sound dampened room
Selection after transients
FFT analysis of identical time intervals
Time (seconds)
Fre
quen
cy (
Hz)
Am
plitu
de (
dB)
AnalysisWindow
?
![Page 13: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/13.jpg)
Square (Aluminum)Square (Aluminum)
Frequency (Hz)
Sou
nd P
ress
ure
Leve
l (dB
/Hz)
60
40
20
100 200 500 1000 2000
Materials
Model
![Page 14: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/14.jpg)
Square (Steel)Square (Steel)
Frequency (Hz)
Sou
nd P
ress
ure
Leve
l (dB
/Hz)
60
40
20
100 200 500 1000 2000
Materials
Model
![Page 15: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/15.jpg)
Rectangle (Aluminum)Rectangle (Aluminum)
Frequency (Hz)
Sou
nd P
ress
ure
Leve
l (dB
/Hz)
60
40
20
100 200 500 1000 2000
Materials
Model
?
![Page 16: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/16.jpg)
Frequency (Hz)
Sou
nd P
ress
ure
Leve
l (dB
/Hz)
60
40
20
100 200 500 1000 2000
Materials
Model
Odd Shaped Plates - “S”Odd Shaped Plates - “S”
![Page 17: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/17.jpg)
Odd Shaped Plates - “G”Odd Shaped Plates - “G”
Frequency (Hz)
Sou
nd P
ress
ure
Leve
l (dB
/Hz)
60
40
20
100 200 500 1000 2000
Materials
Model
![Page 18: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/18.jpg)
Demo PlateDemo Plate
![Page 19: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/19.jpg)
Demo Odd ShapeDemo Odd Shape
![Page 20: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/20.jpg)
Summary and DiscussionSummary and Discussion
System for generating “ringing” sounds
More “natural” => more interesting
Real-time generation of strike-sounds.
System may become predictive enough to allow interactive design of new “bells”
Real-time shape modifications an re-analysis ?
Extensions:
Non-linear phenomena during initial strike
Include coupling with environment (air).
![Page 21: Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin](https://reader036.vdocuments.net/reader036/viewer/2022062323/56815306550346895dc12a83/html5/thumbnails/21.jpg)
AcknowledgementsAcknowledgements
Apple Computer
Ruzena Basjcy
David Bindel
Jon Drukman
Justin Maxwell
James McCartney
Kim Silverman
Bill Stewart