non-conformant harmonization: the real book in the style
TRANSCRIPT
![Page 1: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/1.jpg)
Non-Conformant Harmonization: the Real
Book in the Style of Take 6
www.flow-machines.com
François Pachet & Pierre Roy
![Page 2: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/2.jpg)
Creativity often arises from playingwith styles
Ghedini et al. The Flow Machines project. Ijcai 2013 and AAAI 2013 best video award
![Page 3: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/3.jpg)
Texture and Structure
Style = Texture
![Page 4: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/4.jpg)
Texture and Structure
Style = Texture Constraint = Structure
![Page 5: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/5.jpg)
Texture and Structure
Style = Texture Constraint = Structure
= New object
![Page 6: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/6.jpg)
Style and Markov chains
Markovian Amnesia:
𝑃 𝑠𝑖 𝑠1, 𝑠2, . . , 𝑠𝑖−1) = 𝑃 𝑠𝑖 𝑠𝑖−1)
Random Walk = doodling= non controllable
![Page 7: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/7.jpg)
Beyond random walk: principled generation
General Solution for optimization problems:Pachet, F. and Roy, P. Markov constraints: steerable generation of Markov sequences, Constraints, 2011.
Unary constraints solved in polynomial time:Pachet, Roy & Barbieri, Finite-Length Markov Processes with Constraints, IJCAI 2011
Meter in pseudo-polynomial time:Roy, P. and Pachet, F. Enforcing Meter in Finite-Length Markov Sequences. AAAI, 2013
MaxOrder (= enforcing novelty) in linear time ! Papadopoulos, A., Roy, P., Pachet, F. Avoiding Plagiarism in Markov Sequence Generation, AAAI, 2014
http://www.flow-machines.com/maxOrder
![Page 8: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/8.jpg)
Beyond random walk: combinatorialsequence generation
General Solution for optimization problems:Pachet, F. and Roy, P. Markov constraints: steerable generation of Markov sequences, Constraints, 2011.
Unary constraints solved in polynomial time:Pachet, Roy & Barbieri, Finite-Length Markov Processes with Constraints, IJCAI 2011
Meter in pseudo-polynomial time:Roy, P. and Pachet, F. Enforcing Meter in Finite-Length Markov Sequences. AAAI, 2013
MaxOrder (= enforcing novelty) in linear time ! Papadopoulos, A., Roy, P., Pachet, F. Avoiding Plagiarism in Markov Sequence Generation, AAAI, 2014
http://www.flow-machines.com/maxOrder
![Page 9: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/9.jpg)
Style in Harmonization ?
• Leadsheet = melody with chord sequencegiven1
• Produce a harmonization (n-parts) « in the style » of a given arranger
• Paradigmatic constraint: use only chordsfound in the corpus of the composer
Pachet, F., Suzda, J., Martin, D. A Comprehensive Online Database of Machine-Readable Lead Sheets for Jazz Standards. ISMIR, Curitiba (Brazil), November 2013.
http://lsdb.flow-machines.com
![Page 10: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/10.jpg)
Harmonization is an old problem !
Luc Steels, Learning the craft of musical composition, ICMC 1986
![Page 11: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/11.jpg)
Goal: leadsheet given, produce N-voices, in a given style
![Page 12: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/12.jpg)
A classical problem, but
Existing approaches generate at best:
– Conformant harmonization: C major has C, E, G
– General, agnostic approaches
– Would you, author, dare to play these examples to top musicians?
Musically not interesting, surprinsing, novel
Well-defined problem but the real problem has been « definedaway » 1
=> Not creative (whatever this means)
1 Expression is from Stuart Russell, Ijcai computer and thoughts award ceremony, 1995
![Page 13: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/13.jpg)
What do I mean by non-conformant ?
« Hark the herald angels sing »by Take 6
![Page 14: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/14.jpg)
How to model non-conformance ?
• Random ? Beurk
• Unleash homophonic constraint withcontrolled boundaries
== Unary Markov constraints
• Guarantees that all solutions are found withtheir right probabilities
• Polynomial time !
![Page 15: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/15.jpg)
A famous leadsheet: Giant Steps by J. Coltrane
![Page 16: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/16.jpg)
Varying Harmonic Distance does not work !
B D7 G Bb7 Eb maj7 A m7 D7 G Bb7𝜀 = 0
𝜀 = .2
𝜀 = .34
![Page 17: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/17.jpg)
Fioritures as controlled walks
A min D 7 A min D 7
A min D 7 A min D 7
A min D 7
harmonize
![Page 18: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/18.jpg)
Giant Steps by Wagner
![Page 19: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/19.jpg)
Why Take 6 ?
One of the best vocal arranging style
Rich harmonisations, very recognizable
10 Grammy awards
Very hard to imitate(even to transcribe!)
![Page 20: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/20.jpg)
Giant Steps by Take 6
![Page 21: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/21.jpg)
Ivan Lins – Começar de Novo (The Island )
Grammy-winning Brazilian songwriter. His 1989 hit song "Love Dance" is one of the most re-recorded songs in musical history
![Page 22: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/22.jpg)
Começar de Novo harmonized by Take 6
Rio, October 31st, 2013
![Page 23: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/23.jpg)
Solar With Fioritures
![Page 24: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/24.jpg)
Constraints:Giant Steps by John Coltrane
Giant Steps by Wagner
Style: Wagner, Take 6, etc.
Or by any composer for which we have enough polyphonic scores
Gesualdo, Bach, Haydn, Mozart, Debussy, Bill Evans, Luc Steels (!)
![Page 25: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/25.jpg)
Constraints24 chords, all different
The « Boulez Blues » (aka the « Blouze »)
𝑶𝒑𝒕𝒊𝒎𝒊𝒛𝒆 𝑷(𝒔𝟏, 𝒔𝟐, . . , 𝒔𝒏) = 𝑷(𝒔𝟏)
𝒊=𝟐
𝒏
𝑷 𝒔𝒊 𝒔𝒊−𝟏)
StyleAll blues composed by Charlie Parker
And we want the most probable ! (the most « Charlie Parkerian »)
Pachet, F. and Roy, P. Markov constraints: steerable generation of Markov sequences, Constraints, 2011
![Page 26: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/26.jpg)
Constraints:Prosody and rhymes of Yesterday
Yesterday by Bob Dylan
Style: All lyrics by Bob Dylan
And we get yesterday by Bob Dylan, ACDC, Madonna, etc.
Barbieri, Pachet, Roy & Degli Esposti, Markov Constraints for Text Generation with Style, ECAI 2012
![Page 27: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/27.jpg)
Conclusion
• Style as a constrainable texture • Constraints outside the genre usually generate
interesting artefacts• But homophonic harmonization for melodies outside
the harmonization style does not work well• Fioritures enable style expression and become a device
for creation: a paradox !• But enables the generation of musically challenging
productions that I am not ashamed to play to experts• Web radio soon online to listen to examples endlessly
The paper: www.flow-machines.com/harmonization
The radio: http://lsdb.flow-machines.com/radio-sonycsl.php
![Page 28: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/28.jpg)
Style + constraint
Chord progressions
Lyrics
harmonization
But also melodies (solos), leadsheets, accompaniments, etc.
![Page 29: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/29.jpg)
Preliminary studies
• Real Book (about 400 leadsheets)
• Homophonic harmonization: 1 note = 1 chord
• Markov model of chords
• Various viewpoints, from very precise to verydegraded
=> does not work !
Markov models too sparse
![Page 30: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/30.jpg)
Study on the Real Book
0
20
40
60
80
100
120
140
160
180
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100
nb
of
success
ful
harm
on
izati
on
epsilon (%)
identity
bass, tenor, soprano
bass, soprano
soprano
![Page 31: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/31.jpg)
Harmonization examples
• Jobim: A Felicidade
• T. Monk: Around Midnight
• J. Coltrane: Giant Steps
• Jobim: Desafinado
• Bill Evans: Very Early
• P. McCartney: Yesterday
• Bill Evans: Turn out the stars
http://www.flow-machines.com/harmonization
![Page 32: Non-Conformant Harmonization: the Real Book in the Style](https://reader031.vdocuments.net/reader031/viewer/2022012002/61d8e614cf7d644f7a5769ff/html5/thumbnails/32.jpg)
Virtuoso
Pachet, F. Bebop Virtuosity Explained McCormack & d'Inverno, Eds. Computers and Creativity, Springer, 2012