Skip to main navigation Skip to search Skip to main content

Automatic Subtitle Placement Through Active Speaker Identification in Multimedia Documents

  • ARTEMIS Department
  • Institut Polytechnique de Paris
  • University 'Politehnica' of Bucharest

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Subtitle plays an important role in transmitting the multimedia informational content and represents the most prominent solution to substitute the audio channel in the context of deaf and hearing impaired people (HIP). In this paper we introduce a novel dynamic subtitle positioning system designed to increase the accessibility of HIP to video documents. We propose to dynamically position each textual segment in the near vicinity of the active speaker, which allows the viewer to follow the visual semantic content while simultaneously reading the subtitles. The framework exploits a rich set of technologies including: video structuring into shots and scenes, active speaker recognition, visual semantic analysis in order to position the scripts at suitable locations while increasing the HIP audience level of content understanding. The objective experimental evaluation conducted on 20 video files demonstrates the effectiveness and usefulness of the proposed approach.

Original languageEnglish
Title of host publication2021 9th E-Health and Bioengineering Conference, EHB 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665440004
DOIs
Publication statusPublished - 1 Jan 2021
Event9th IEEE International Conference on E-Health and Bioengineering Conference, EHB 2021 - Iasi, Romania
Duration: 18 Nov 2021 → 19 Nov 2021

Publication series

Name2021 9th E-Health and Bioengineering Conference, EHB 2021

Conference

Conference9th IEEE International Conference on E-Health and Bioengineering Conference, EHB 2021
Country/TerritoryRomania
CityIasi
Period18/11/21 → 19/11/21

Keywords

  • audio substitution
  • content enhancement
  • dynamic subtitle
  • hearing impaired users

Fingerprint

Dive into the research topics of 'Automatic Subtitle Placement Through Active Speaker Identification in Multimedia Documents'. Together they form a unique fingerprint.

Cite this