seven league boots a gan based drum pattern for music ...vogl/slides/ismir-18-demo.pdf · > drum...
TRANSCRIPT
www.giantsteps-project.eu
SEVEN LEAGUE BOOTS FOR MUSIC CREATION AND PERFORMANCE
GiantSteps is partly funded by the European Community’s Seventh Framework Programme.
http://www.cp.jku.at/people/eghbal-zadehhttp://www.ifs.tuwien.ac.at/~vogl/http://www.cp.jku.at/people/widmer/https://www.ifs.tuwien.ac.at/~knees/
variation algorithm> as pattern creation engine, the generator of a GAN is used> the network architecture for both generator and discriminator
uses a convolutional recurrent layout> convolutions are used to model patterns within one bar while
the recurrent layers allow to model a varying number of bars> the GAN is trained on a large scale data set featuring genre
annotations and calculated complexity and intensity features> the dataset consists of drum patterns transcribed from the
GiantSteps dataset3 and patterns extracted from a MIDI dataset4
A GAN Based Drum Pattern Generation UI Prototype
user interface
introduction> digitally created drum tracks are commonly used
in modern music production environments> drum patterns are either manually created or
predefined patterns from a pattern library are used> manual composition is a labor intensive task but
often the preferred method to ensure originality> in this work a prototype to assist the artist in the
workflow for this task is introduced> a major goal is to make the process more fun and
spark creativity
future work> improve GAN training and UI> objective evaluation of generated patterns> user study to evaluate prototype
1
prototype> the user interface is touch screen based, for easy interaction> a drum step sequencer located in the upper part is used to visualize and
edit drum patterns > a central x/y pad in the bottom part controls complexity (y) and intensity
(x) of the generated patterns, while the left knob allows to select a genre> the knob right to the pad allows to scroll through generated patterns> controls for playback, as well as for tempo and swing are located to the
very left and right in the control area> MIDI output and Ableton Link support allow for easy integration and
synchronization with DAWs
1 2
3
4
1: 2:
* Equal contribution
[email protected] Eghbal-zadeh*1
[email protected] Vogl*1,2
3 http://www.cp.jku.at/datasets/giantsteps/
4 http://ifs.tuwien.ac.at/~vogl/dafx2018/
Gerhard Widmer1
[email protected] Knees2
GAN training
generatedexample
realexample
example dataset
x x
z, y, c
p
Xgenerator network
discriminator network
probability of class (real/fake, genre, features)
conditional variables (y, c)input noise (z)
D
G