Enhanced visualisation of dance performance from automatically synchronised multimodal recordings

Marc Gowing; Philip Kell; Noel E. O'Connor; Cyril Concolato; Slim Essid; Jean Lefeuvre; Robin Tournemenne; Ebroul Izquierdo; Vlado Kitanovski; Xinyu Lin; Qianni Zhang

doi:10.1145/2072298.2072414

Enhanced visualisation of dance performance from automatically synchronised multimodal recordings

Marc Gowing
, Philip Kell
, Noel E. O'Connor
, Cyril Concolato
, Slim Essid
, Jean Lefeuvre
, Robin Tournemenne
, Ebroul Izquierdo
, Vlado Kitanovski
, Xinyu Lin
, Qianni Zhang

Dublin City University
CNRS LTCI
Queen Mary University of London

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The Huawei/3DLife Grand Challenge Dataset provides multimodal recordings of Salsa dancing, consisting of audiovisual streams along with depth maps and inertial measurements. In this paper, we propose a system for augmented reality-based evaluations of Salsa dancer performances. An essential step for such a system is the automatic temporal synchronisation of the multiple modalities captured from different sensors, for which we propose efficient solutions. Furthermore, we contribute modules for the automatic analysis of dance performances and present an original software application, specifically designed for the evaluation scenario considered, which enables an enhanced dance visualisation experience, through the augmentation of the original media with the results of our automatic analyses.

Original language	English
Title of host publication	MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops
Pages	667-670
Number of pages	4
DOIs	https://doi.org/10.1145/2072298.2072414
Publication status	Published - 29 Dec 2011
Externally published	Yes
Event	19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11 - Scottsdale, AZ, United States Duration: 28 Nov 2011 → 1 Dec 2011

Publication series

Name	MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

Conference

Conference	19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11
Country/Territory	United States
City	Scottsdale, AZ
Period	28/11/11 → 1/12/11

Keywords

Audio
Multimodal processing
Synchronisation
Video

Access to Document

10.1145/2072298.2072414

Cite this

Gowing, M., Kell, P., O'Connor, N. E., Concolato, C., Essid, S., Lefeuvre, J., Tournemenne, R., Izquierdo, E., Kitanovski, V., Lin, X., & Zhang, Q. (2011). Enhanced visualisation of dance performance from automatically synchronised multimodal recordings. In MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops (pp. 667-670). (MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops). https://doi.org/10.1145/2072298.2072414

@inproceedings{dadea434f1bc4db591bfc097dc88cd61,

title = "Enhanced visualisation of dance performance from automatically synchronised multimodal recordings",

abstract = "The Huawei/3DLife Grand Challenge Dataset provides multimodal recordings of Salsa dancing, consisting of audiovisual streams along with depth maps and inertial measurements. In this paper, we propose a system for augmented reality-based evaluations of Salsa dancer performances. An essential step for such a system is the automatic temporal synchronisation of the multiple modalities captured from different sensors, for which we propose efficient solutions. Furthermore, we contribute modules for the automatic analysis of dance performances and present an original software application, specifically designed for the evaluation scenario considered, which enables an enhanced dance visualisation experience, through the augmentation of the original media with the results of our automatic analyses.",

keywords = "Audio, Multimodal processing, Synchronisation, Video",

author = "Marc Gowing and Philip Kell and O'Connor, \{Noel E.\} and Cyril Concolato and Slim Essid and Jean Lefeuvre and Robin Tournemenne and Ebroul Izquierdo and Vlado Kitanovski and Xinyu Lin and Qianni Zhang",

year = "2011",

month = dec,

day = "29",

doi = "10.1145/2072298.2072414",

language = "English",

isbn = "9781450306164",

series = "MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops",

pages = "667--670",

booktitle = "MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops",

note = "19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11 ; Conference date: 28-11-2011 Through 01-12-2011",

}

Gowing, M, Kell, P, O'Connor, NE, Concolato, C, Essid, S, Lefeuvre, J, Tournemenne, R, Izquierdo, E, Kitanovski, V, Lin, X & Zhang, Q 2011, Enhanced visualisation of dance performance from automatically synchronised multimodal recordings. in MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops. MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops, pp. 667-670, 19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11, Scottsdale, AZ, United States, 28/11/11. https://doi.org/10.1145/2072298.2072414

Enhanced visualisation of dance performance from automatically synchronised multimodal recordings. / Gowing, Marc; Kell, Philip; O'Connor, Noel E. et al.
MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops. 2011. p. 667-670 (MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Enhanced visualisation of dance performance from automatically synchronised multimodal recordings

AU - Gowing, Marc

AU - Kell, Philip

AU - O'Connor, Noel E.

AU - Concolato, Cyril

AU - Essid, Slim

AU - Lefeuvre, Jean

AU - Tournemenne, Robin

AU - Izquierdo, Ebroul

AU - Kitanovski, Vlado

AU - Lin, Xinyu

AU - Zhang, Qianni

PY - 2011/12/29

Y1 - 2011/12/29

N2 - The Huawei/3DLife Grand Challenge Dataset provides multimodal recordings of Salsa dancing, consisting of audiovisual streams along with depth maps and inertial measurements. In this paper, we propose a system for augmented reality-based evaluations of Salsa dancer performances. An essential step for such a system is the automatic temporal synchronisation of the multiple modalities captured from different sensors, for which we propose efficient solutions. Furthermore, we contribute modules for the automatic analysis of dance performances and present an original software application, specifically designed for the evaluation scenario considered, which enables an enhanced dance visualisation experience, through the augmentation of the original media with the results of our automatic analyses.

AB - The Huawei/3DLife Grand Challenge Dataset provides multimodal recordings of Salsa dancing, consisting of audiovisual streams along with depth maps and inertial measurements. In this paper, we propose a system for augmented reality-based evaluations of Salsa dancer performances. An essential step for such a system is the automatic temporal synchronisation of the multiple modalities captured from different sensors, for which we propose efficient solutions. Furthermore, we contribute modules for the automatic analysis of dance performances and present an original software application, specifically designed for the evaluation scenario considered, which enables an enhanced dance visualisation experience, through the augmentation of the original media with the results of our automatic analyses.

KW - Audio

KW - Multimodal processing

KW - Synchronisation

KW - Video

U2 - 10.1145/2072298.2072414

DO - 10.1145/2072298.2072414

M3 - Conference contribution

AN - SCOPUS:84455172916

SN - 9781450306164

T3 - MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

SP - 667

EP - 670

BT - MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

T2 - 19th ACM International Conference on Multimedia ACM Multimedia 2011, MM'11

Y2 - 28 November 2011 through 1 December 2011

ER -

Gowing M, Kell P, O'Connor NE, Concolato C, Essid S, Lefeuvre J et al. Enhanced visualisation of dance performance from automatically synchronised multimodal recordings. In MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops. 2011. p. 667-670. (MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops). doi: 10.1145/2072298.2072414

Enhanced visualisation of dance performance from automatically synchronised multimodal recordings

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this