TY - GEN
T1 - A Hitchhiker's Guide towards Transactive Memory System Modeling in Small Group Interactions
AU - Tartaglione, Enzo
AU - Biancardi, Beatrice
AU - Mancini, Maurizio
AU - Varni, Giovanna
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/10/18
Y1 - 2021/10/18
N2 - Modeling Transactive Memory System (TMS) over time is an actual challenge of Human-Centered Computing. TMS is a group's meta-knowledge indicating the attribute of "who knows what". Conceiving and developing machines able to deal with TMS is a relevant step in the field of Hybrid Intelligence aiming at creating systems where human and artificial teammates cooperate in synergistic fashion. Recently, a TMS dataset has been proposed, where a number of audio and visual automated features and manual annotations are extracted taking inspiration from Social Sciences literature. Is it possible, on top of these, to model relationships between these engineered features and the TMS scores In this work we first build and discuss a processing pipeline; then we propose four possible classifiers, two of which are artificial neural networks-based. We observe that the largest obstacle towards modeling the target relationships currently lies in the little data availability for training an automatic system. Our purpose, with this work, is to provide hints on how to avoid some common pitfalls to train these systems to learn TMS scores from audio/visual features.
AB - Modeling Transactive Memory System (TMS) over time is an actual challenge of Human-Centered Computing. TMS is a group's meta-knowledge indicating the attribute of "who knows what". Conceiving and developing machines able to deal with TMS is a relevant step in the field of Hybrid Intelligence aiming at creating systems where human and artificial teammates cooperate in synergistic fashion. Recently, a TMS dataset has been proposed, where a number of audio and visual automated features and manual annotations are extracted taking inspiration from Social Sciences literature. Is it possible, on top of these, to model relationships between these engineered features and the TMS scores In this work we first build and discuss a processing pipeline; then we propose four possible classifiers, two of which are artificial neural networks-based. We observe that the largest obstacle towards modeling the target relationships currently lies in the little data availability for training an automatic system. Our purpose, with this work, is to provide hints on how to avoid some common pitfalls to train these systems to learn TMS scores from audio/visual features.
KW - Explainable Models
KW - Multi-modal Group Behaviour Analysis
KW - Social Signal Processing
KW - Transactive Memory System
U2 - 10.1145/3461615.3485414
DO - 10.1145/3461615.3485414
M3 - Conference contribution
AN - SCOPUS:85122268557
T3 - ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction
SP - 254
EP - 262
BT - ICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction
PB - Association for Computing Machinery, Inc
T2 - 23rd ACM International Conference on Multimodal Interaction, ICMI 2021
Y2 - 18 October 2021 through 22 October 2021
ER -