formant estimation in singing studiovoicestudies/artts/doc/presentations/... · •singing analysis...
TRANSCRIPT
![Page 1: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/1.jpg)
1
Formant estimation in Singing Studio
PROJECT MEETING
Vítor Almeida
Faculdade de Engenharia da Universidade do Porto, Porto
January 19th, 2013
![Page 2: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/2.jpg)
2
Formant estimation algorithm
Project Meeting January 19th, 2013
Features:
- Analysis window : 1024 samples, 75% overlap, sine window.
- Sampling frequency: 22050 Hz.
![Page 3: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/3.jpg)
3
Formant estimation algorithm
Project Meeting January 19th, 2013
Estimation of noise component:
![Page 4: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/4.jpg)
4
Formant estimation algorithm
Project Meeting January 19th, 2013
Estimation of formant candidates using LPC and Cepstrum:
![Page 5: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/5.jpg)
5
Formant estimation algorithm
Project Meeting January 19th, 2013
Some difficulties:
• The existence of vibrato makes hard the noise estimation
• The closeness between two or more formants
• Finding a rule for the selection and validation the candidates
![Page 6: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/6.jpg)
6
Formant estimation algorithm
Project Meeting January 19th, 2013
In SingingStudio:
![Page 7: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/7.jpg)
7
Vibrato analysis in Singing Studio
PROJECT MEETING
Ricardo Sousa
Faculdade de Engenharia da Universidade do Porto, Porto
January 19th, 2013
![Page 8: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/8.jpg)
8
Introduction
• Context and Objectives
• Singing analysis and bio-feedback applied to singing training/teaching
• Acoustic vibrato parameterization
Robust
Descriptive
Objective
Physiological meaning
• Automatic vibrato detection
• Visual interface of vibrato analysis
Project Meeting January 19th, 2013
![Page 9: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/9.jpg)
9
Method
•Analysis Algorithm
Pitch Segment
selection
Vibrato Segment
detection
Parameter
Computation
Pitch Estimation
Voice
Signal
Pitch curve
Pitch
Segments
Vibrato
Segments
Vibrato
Parameters
Step 1
Step 2
Step 3
Step 4
January 19th, 2013 Project Meeting
-Spectral based methods
-Frame based
- FFT interpolation (accurate
F0 estimation)
![Page 10: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/10.jpg)
10
Method
![Page 11: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/11.jpg)
11
Method
•Vibrato percentage: Ratio of vibrato duration and the entire theme duration
•Mean Duration: Mean duration of all segments.
•Mean frequency: Mean frequency of all segments.
•Mean extension: Mean extension of all segments.
•Sinusoidal Purity: Measure the regularity of vibrato (similarity to sinusoidal waveform)
•Vibrato parameters
Duration
1/Frequency
Extension
January 19th, 2013 Project Meeting
![Page 12: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/12.jpg)
12
Results
• Automatic detection of vibrato segments
Vibrato detection 1 Vibrato detection 2
January 19th, 2013 Project Meeting
Additional features:
• Manual adjustment of vibrato segments
![Page 13: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/13.jpg)
13
Results
• Qualitative and Quantitative Evaluation
Irregular vibrato Regular vibrato
Observation:
• Qualitative evaluation: “Good vibrato”, “Bad vibrato”
January 19th, 2013 Project Meeting
![Page 14: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/14.jpg)
14
Conclusion
• Qualitative and Quantitative evaluation of vibrato.
• Visualization and bio-feedback.
• Automatic analysis.
• Physiological interpretation.
• Interactive interface.
January 19th, 2013 Project Meeting
![Page 15: Formant estimation in Singing Studiovoicestudies/artts/doc/presentations/... · •Singing analysis and bio-feedback applied to singing training/teaching •Acoustic vibrato parameterization](https://reader034.vdocuments.net/reader034/viewer/2022042023/5e7b39fef00a3e164f6605c8/html5/thumbnails/15.jpg)
15
Truly grateful!
January 19th, 2013 Project Meeting