A Hitchhiker's Guide towards Transactive Memory System Modeling in Small Group Interactions

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Modeling Transactive Memory System (TMS) over time is an actual challenge of Human-Centered Computing. TMS is a group's meta-knowledge indicating the attribute of "who knows what". Conceiving and developing machines able to deal with TMS is a relevant step in the field of Hybrid Intelligence aiming at creating systems where human and artificial teammates cooperate in synergistic fashion. Recently, a TMS dataset has been proposed, where a number of audio and visual automated features and manual annotations are extracted taking inspiration from Social Sciences literature. Is it possible, on top of these, to model relationships between these engineered features and the TMS scores In this work we first build and discuss a processing pipeline; then we propose four possible classifiers, two of which are artificial neural networks-based. We observe that the largest obstacle towards modeling the target relationships currently lies in the little data availability for training an automatic system. Our purpose, with this work, is to provide hints on how to avoid some common pitfalls to train these systems to learn TMS scores from audio/visual features.

Original languageEnglish
Title of host publicationICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction
PublisherAssociation for Computing Machinery, Inc
Pages254-262
Number of pages9
ISBN (Electronic)9781450384711
DOIs
Publication statusPublished - 18 Oct 2021
Externally publishedYes
Event23rd ACM International Conference on Multimodal Interaction, ICMI 2021 - Virtual, Online, Canada
Duration: 18 Oct 202122 Oct 2021

Publication series

NameICMI 2021 Companion - Companion Publication of the 2021 International Conference on Multimodal Interaction

Conference

Conference23rd ACM International Conference on Multimodal Interaction, ICMI 2021
Country/TerritoryCanada
CityVirtual, Online
Period18/10/2122/10/21

Keywords

  • Explainable Models
  • Multi-modal Group Behaviour Analysis
  • Social Signal Processing
  • Transactive Memory System

Fingerprint

Dive into the research topics of 'A Hitchhiker's Guide towards Transactive Memory System Modeling in Small Group Interactions'. Together they form a unique fingerprint.

Cite this