Skip to main navigation Skip to search Skip to main content

Multi-Channel Biometrics for eHealth Combining Acoustic and Machine Vision Analysis of Speech, Lip Movement and Face: A Case Study

  • Emmanouil G. Spanakis
  • , Iacob Crucianu
  • , Marcel Kockmann
  • , Dijana Petrovska-Delacrétaz
  • , Aymen Mtibaa
  • , Christian Narr
  • , Daniel Takacs
  • , Claude Bauzou
  • , Mohamed Amine Hmani
  • , Elnar Hajiyev
  • , Apostolos Karantanas
  • Foundation for Research and Technology-Hellas
  • SIVECO
  • Lumenvox
  • Telecom Sudparis
  • Real Eyes Budapest
  • IDEMIA France
  • Realeyes
  • University of Crete Medical School

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The purpose of this work is to present a solution combining user-friendliness and cost-effectiveness use of audio (speech) visual (video/image) biometrics, for eHealth, able to achieve better accuracy and increase the ability to avoid counterfeiting. This work shows the evaluation results for an eHealth pilot study that tested the security, privacy, usability and cost-effective features of a user authentication platform for the management of sensitive heterogeneous multi-scale medical data (i.e. medical imaging such as MRI/CT scans, physical reports, and laboratory results), through easy acquisition of biometric data via laptops, and tablets equipped with cameras and microphones. Regarding the user enrollment and verification, audio-visual biometric information from an individual is captured, processed and stored as a biometric template. In subsequent uses, biometric information is captured and compared with the biometric templates. If the comparison is successful the verified user could be allowed to sign in to a medical collaboration platform of the hospitals infrastructure. In this work we present the biometric platform developed, the testing methodology and the administrative framework and legal processes, related to GDPR, for the eHealth pilot study and the results from our quantitative and qualitative analysis that was performed.

Original languageEnglish
Title of host publicationIST 2019 - IEEE International Conference on Imaging Systems and Techniques, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728138688
DOIs
Publication statusPublished - 1 Dec 2019
Event2019 IEEE International Conference on Imaging Systems and Techniques, IST 2019 - Abu Dhabi, United Arab Emirates
Duration: 8 Dec 201910 Dec 2019

Publication series

NameIST 2019 - IEEE International Conference on Imaging Systems and Techniques, Proceedings

Conference

Conference2019 IEEE International Conference on Imaging Systems and Techniques, IST 2019
Country/TerritoryUnited Arab Emirates
CityAbu Dhabi
Period8/12/1910/12/19

Keywords

  • RIS/PACS
  • access control
  • biometrics
  • eHealth
  • evaluation study
  • face recognition
  • pilot
  • speaker recognition

Fingerprint

Dive into the research topics of 'Multi-Channel Biometrics for eHealth Combining Acoustic and Machine Vision Analysis of Speech, Lip Movement and Face: A Case Study'. Together they form a unique fingerprint.

Cite this