Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning

Bogdan Mocanu; Ruxandra Tapu; Titus Zaharia

doi:10.1109/EHB47216.2019.8970038

Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning

Bogdan Mocanu
, Ruxandra Tapu
, Titus Zaharia

CNRS SAMOVAR UMR 5157
University 'Politehnica' of Bucharest

Résultats de recherche: Le chapitre dans un livre, un rapport, une anthologie ou une collection › Contribution à une conférence › Revue par des pairs

9 Citations (Scopus)

Résumé

In this paper we introduce an automatic subtitle positioning approach designed to enhance the video accessibility of deaf and hearing impaired people to multimedia documents. By using a dynamic subtitle and captioning approach, which exploits various computer vision techniques, including face detection, tracking and recognition, video temporal segmentation into shots and scenes and active speaker recognition, we are able to position each video subtitle segment in the near vicinity of the active speaker. The experimental evaluation performed on 30 video elements validates our approach with average F1-scores superior to 92%.

langue originale	Anglais
titre	2019 7th E-Health and Bioengineering Conference, EHB 2019
Editeur	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronique)	9781728126036
Les DOIs	https://doi.org/10.1109/EHB47216.2019.8970038
état	Publié - 1 nov. 2019
Modification externe	Oui
Evénement	7th IEEE International Conference on E-Health and Bioengineering, EHB 2019 - Iasi, Roumanie Durée: 21 nov. 2019 → 23 nov. 2019

Série de publications

Nom	2019 7th E-Health and Bioengineering Conference, EHB 2019

Une conférence

Une conférence	7th IEEE International Conference on E-Health and Bioengineering, EHB 2019
Pays/Territoire	Roumanie
La ville	Iasi
période	21/11/19 → 23/11/19

Accès au document

10.1109/EHB47216.2019.8970038

Contient cette citation

Mocanu, B., Tapu, R., & Zaharia, T. (2019). Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning. Dans 2019 7th E-Health and Bioengineering Conference, EHB 2019 Article 8970038 (2019 7th E-Health and Bioengineering Conference, EHB 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EHB47216.2019.8970038

@inproceedings{64adea46c2184a9094ca2bdecebcfc44,

title = "Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning",

abstract = "In this paper we introduce an automatic subtitle positioning approach designed to enhance the video accessibility of deaf and hearing impaired people to multimedia documents. By using a dynamic subtitle and captioning approach, which exploits various computer vision techniques, including face detection, tracking and recognition, video temporal segmentation into shots and scenes and active speaker recognition, we are able to position each video subtitle segment in the near vicinity of the active speaker. The experimental evaluation performed on 30 video elements validates our approach with average F1-scores superior to 92\%.",

keywords = "Active speaker recognition, Deaf and hearing impaired people, Dynamic subtitle",

author = "Bogdan Mocanu and Ruxandra Tapu and Titus Zaharia",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 7th IEEE International Conference on E-Health and Bioengineering, EHB 2019 ; Conference date: 21-11-2019 Through 23-11-2019",

year = "2019",

month = nov,

day = "1",

doi = "10.1109/EHB47216.2019.8970038",

language = "English",

series = "2019 7th E-Health and Bioengineering Conference, EHB 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2019 7th E-Health and Bioengineering Conference, EHB 2019",

}

Mocanu, B, Tapu, R & Zaharia, T 2019, Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning. Dans 2019 7th E-Health and Bioengineering Conference, EHB 2019., 8970038, 2019 7th E-Health and Bioengineering Conference, EHB 2019, Institute of Electrical and Electronics Engineers Inc., 7th IEEE International Conference on E-Health and Bioengineering, EHB 2019, Iasi, Roumanie, 21/11/19. https://doi.org/10.1109/EHB47216.2019.8970038

Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning. / Mocanu, Bogdan; Tapu, Ruxandra ; Zaharia, Titus.
2019 7th E-Health and Bioengineering Conference, EHB 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8970038 (2019 7th E-Health and Bioengineering Conference, EHB 2019).

Résultats de recherche: Le chapitre dans un livre, un rapport, une anthologie ou une collection › Contribution à une conférence › Revue par des pairs

TY - GEN

T1 - Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning

AU - Mocanu, Bogdan

AU - Tapu, Ruxandra

AU - Zaharia, Titus

PY - 2019/11/1

Y1 - 2019/11/1

N2 - In this paper we introduce an automatic subtitle positioning approach designed to enhance the video accessibility of deaf and hearing impaired people to multimedia documents. By using a dynamic subtitle and captioning approach, which exploits various computer vision techniques, including face detection, tracking and recognition, video temporal segmentation into shots and scenes and active speaker recognition, we are able to position each video subtitle segment in the near vicinity of the active speaker. The experimental evaluation performed on 30 video elements validates our approach with average F1-scores superior to 92%.

AB - In this paper we introduce an automatic subtitle positioning approach designed to enhance the video accessibility of deaf and hearing impaired people to multimedia documents. By using a dynamic subtitle and captioning approach, which exploits various computer vision techniques, including face detection, tracking and recognition, video temporal segmentation into shots and scenes and active speaker recognition, we are able to position each video subtitle segment in the near vicinity of the active speaker. The experimental evaluation performed on 30 video elements validates our approach with average F1-scores superior to 92%.

KW - Active speaker recognition

KW - Deaf and hearing impaired people

KW - Dynamic subtitle

U2 - 10.1109/EHB47216.2019.8970038

DO - 10.1109/EHB47216.2019.8970038

M3 - Conference contribution

AN - SCOPUS:85079356501

T3 - 2019 7th E-Health and Bioengineering Conference, EHB 2019

BT - 2019 7th E-Health and Bioengineering Conference, EHB 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 7th IEEE International Conference on E-Health and Bioengineering, EHB 2019

Y2 - 21 November 2019 through 23 November 2019

ER -

Enhancing the accessibility of hearing impaired to video content through fully automatic dynamic captioning

Résumé

Série de publications

Une conférence

Accès au document

Empreinte digitale

Contient cette citation