Embodied exploration of deep latent spaces in interactive dance-music performance

Sarah Nabi, Philippe Esling, Geoffroy Peeters, Frédéric Bevilacqua

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, significant advances have been made in deep learning models for audio generation, offering promising tools for musical creation. In this work, we investigate the use of deep audio generative models in interactive dance/music performance. We adopted a performance-led research design approach, establishing an art-research collaboration between a researcher/musician and a dancer. First, we describe our motion-sound interactive system integrating deep audio generative model and propose three methods for embodied exploration of deep latent spaces. Then, we detail the creative process for building the performance centered on the co-design of the system. Finally, we report feedback from the dancer's interviews and discuss the results and perspectives. The code implementation is publicly available on our github1.

Original languageEnglish
Title of host publicationProceedings of the 9th International Conference on Movement and Computing
Subtitle of host publicationMOCO 2024 Beyond Control
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400709944
DOIs
Publication statusPublished - 30 May 2024
Event9th International Conference on Movement and Computing, MOCO 2024 Beyond Control - Utrecht, Netherlands
Duration: 30 May 20242 Jun 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference9th International Conference on Movement and Computing, MOCO 2024 Beyond Control
Country/TerritoryNetherlands
CityUtrecht
Period30/05/242/06/24

Keywords

  • HCI
  • dance-music-AI performance
  • deep learning
  • embodied exploration
  • generative models
  • latent space
  • motion-sound interaction

Fingerprint

Dive into the research topics of 'Embodied exploration of deep latent spaces in interactive dance-music performance'. Together they form a unique fingerprint.

Cite this