Visualtouch: Enhancing affective touch communication with multi-modality stimulation

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As one of the most important non-verbal communication channel, touch plays an essential role in interpersonal affective communication. Although some researchers have started exploring the possibility of using wearable devices for conveying emotional information, most of the existing devices still lack the capability to support affective and dynamic touch in interaction. In this paper, we explore the effect of dynamic visual cues on the emotional perception of vibrotactile signals. For this purpose, we developed VisualTouch, a haptic sleeve consisting of a haptic layer and a visual layer.We hypothesized that visual cueswould enhance the interpretation of tactile cues when both types of cues are congruent. We first carried out an experiment and selected 4 stimuli producing substantially different responses. Based on that, a second experiment was conducted with 12 participants rating the valence and arousal of 36 stimuli using SAM scales.

Original languageEnglish
Title of host publicationICMI 2019 - Proceedings of the 2019 International Conference on Multimodal Interaction
EditorsWen Gao, Helen Mei Ling Meng, Matthew Turk, Susan R. Fussell, Bjorn Schuller, Bjorn Schuller, Yale Song, Kai Yu
PublisherAssociation for Computing Machinery, Inc
Pages114-123
Number of pages10
ISBN (Electronic)9781450368605
DOIs
Publication statusPublished - 14 Oct 2019
Event21st ACM International Conference on Multimodal Interaction, ICMI 2019 - Suzhou, China
Duration: 14 Oct 201918 Oct 2019

Publication series

NameICMI 2019 - Proceedings of the 2019 International Conference on Multimodal Interaction

Conference

Conference21st ACM International Conference on Multimodal Interaction, ICMI 2019
Country/TerritoryChina
CitySuzhou
Period14/10/1918/10/19

Keywords

  • Color
  • Congruence
  • Multi-modality
  • Social Touch
  • Vibration

Fingerprint

Dive into the research topics of 'Visualtouch: Enhancing affective touch communication with multi-modality stimulation'. Together they form a unique fingerprint.

Cite this