Music Generation by Deep Learning - Challenges and Directions - Sorbonne Université Access content directly
Preprints, Working Papers, ... Year : 2017

Music Generation by Deep Learning - Challenges and Directions

Jean-Pierre Briot
Francois Pachet
  • Function : Author


In addition to traditional tasks such as prediction, classification and translation, deep learning is receiving growing attention as an approach for music generation, as witnessed by recent research groups such as Magenta at Google and CTRL (Creator Technology Research Lab) at Spotify. The motivation is in using the capacity of deep learning architectures and training techniques to automatically learn musical styles from arbitrary musical corpora and then to generate samples from the estimated (learnt) distribution. Meanwhile, a direct application of deep learning generation, such as feedforward on a feedforward or a recurrent architecture, reaches some limits as they tend to mimic the corpus learnt without incentive for creativity. Moreover, deep learning architectures do not offer direct ways for controlling generation (e.g., imposing some tonality or other arbitrary constraints). Furthermore, deep learning architectures alone are autistic automata which generate music autonomously without human user interaction, far from the objective of assisting musicians to compose and refine music. Issues such as: control, creativity and interaction are the focus of our analysis. In this paper, we list various limitations of a direct application of deep learning to music generation, analyze why the issues are not fulfilled and how to address them by possible approaches. Various examples of recent systems are cited as examples of promising directions.
Fichier principal
Vignette du fichier
mg-dl-challenges-directions-arxiv-2017.pdf (5.74 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01660753 , version 1 (11-12-2017)




  • HAL Id : hal-01660753 , version 1


Jean-Pierre Briot, Francois Pachet. Music Generation by Deep Learning - Challenges and Directions. 2017. ⟨hal-01660753⟩
680 View
902 Download


Gmail Facebook X LinkedIn More