TY - GEN
T1 - TV News Retrieval Based on Story Segmentation and Concept Association
AU - Tapu, Ruxandra
AU - Mocanu, Bogdan
AU - Zaharia, Titus
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2017/4/21
Y1 - 2017/4/21
N2 - In this paper we propose a novel method for TV news retrieval. A first stage concerns a temporal segmentation into stories units. Then, for each story the most relevant concepts are extracted based on a multimodal fusion between visual and textual information. By analyzing the video stream, we perform global frame representation, image retrieval and re-ranking, in order to determine, with high confidence, the segments boundaries. In addition, by using the video subtitle, we identify the most relevant concepts/topics addressed in each independent segment. The framework is evaluated using one week video archive of France Television and 20 journals from NBC and CNN TV stations. For the temporal video segmentation, our system returns high precision and recall scores, superior to 90%. Regarding the topic association technique, we obtain a mean average precision score superior to 0.5.
AB - In this paper we propose a novel method for TV news retrieval. A first stage concerns a temporal segmentation into stories units. Then, for each story the most relevant concepts are extracted based on a multimodal fusion between visual and textual information. By analyzing the video stream, we perform global frame representation, image retrieval and re-ranking, in order to determine, with high confidence, the segments boundaries. In addition, by using the video subtitle, we identify the most relevant concepts/topics addressed in each independent segment. The framework is evaluated using one week video archive of France Television and 20 journals from NBC and CNN TV stations. For the temporal video segmentation, our system returns high precision and recall scores, superior to 90%. Regarding the topic association technique, we obtain a mean average precision score superior to 0.5.
KW - TV news segmentation
KW - concept association
KW - story units
KW - visual and textual information
U2 - 10.1109/SITIS.2016.60
DO - 10.1109/SITIS.2016.60
M3 - Conference contribution
AN - SCOPUS:85019235811
T3 - Proceedings - 12th International Conference on Signal Image Technology and Internet-Based Systems, SITIS 2016
SP - 327
EP - 334
BT - Proceedings - 12th International Conference on Signal Image Technology and Internet-Based Systems, SITIS 2016
A2 - De Pietro, Giuseppe
A2 - Dipanda, Albert
A2 - Chbeir, Richard
A2 - Gallo, Luigi
A2 - Yetongnon, Kokou
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 12th International Conference on Signal Image Technology and Internet-Based Systems, SITIS 2016
Y2 - 28 November 2016 through 1 December 2016
ER -