TY - GEN
T1 - Embodied exploration of deep latent spaces in interactive dance-music performance
AU - Nabi, Sarah
AU - Esling, Philippe
AU - Peeters, Geoffroy
AU - Bevilacqua, Frédéric
N1 - Publisher Copyright:
© 2024 ACM.
PY - 2024/5/30
Y1 - 2024/5/30
N2 - In recent years, significant advances have been made in deep learning models for audio generation, offering promising tools for musical creation. In this work, we investigate the use of deep audio generative models in interactive dance/music performance. We adopted a performance-led research design approach, establishing an art-research collaboration between a researcher/musician and a dancer. First, we describe our motion-sound interactive system integrating deep audio generative model and propose three methods for embodied exploration of deep latent spaces. Then, we detail the creative process for building the performance centered on the co-design of the system. Finally, we report feedback from the dancer's interviews and discuss the results and perspectives. The code implementation is publicly available on our github1.
AB - In recent years, significant advances have been made in deep learning models for audio generation, offering promising tools for musical creation. In this work, we investigate the use of deep audio generative models in interactive dance/music performance. We adopted a performance-led research design approach, establishing an art-research collaboration between a researcher/musician and a dancer. First, we describe our motion-sound interactive system integrating deep audio generative model and propose three methods for embodied exploration of deep latent spaces. Then, we detail the creative process for building the performance centered on the co-design of the system. Finally, we report feedback from the dancer's interviews and discuss the results and perspectives. The code implementation is publicly available on our github1.
KW - HCI
KW - dance-music-AI performance
KW - deep learning
KW - embodied exploration
KW - generative models
KW - latent space
KW - motion-sound interaction
U2 - 10.1145/3658852.3659072
DO - 10.1145/3658852.3659072
M3 - Conference contribution
AN - SCOPUS:85197749780
T3 - ACM International Conference Proceeding Series
BT - Proceedings of the 9th International Conference on Movement and Computing
PB - Association for Computing Machinery
T2 - 9th International Conference on Movement and Computing, MOCO 2024 Beyond Control
Y2 - 30 May 2024 through 2 June 2024
ER -