Passer à la navigation principale Passer à la recherche Passer au contenu principal

On the correlation of automatic audio and visual segmentations of music videos

  • CNRS LTCI
  • IEEE

Résultats de recherche: Contribution à un journal › Article › Revue par des pairs

42 Citations (Scopus)

Résumé

The study of the associations between audio and video content has numerous important applications in the fields of information retrieval and multimedia content authoring. In this work, we focus on music videos which exhibit a broad range of structural and semantic relationships between the music and the video content. To identify such relationships, a two-level automatic structuring of the music and the video is achieved separately. Note onsets are detected from the music signal, along with section changes. The latter is achieved by a novel algorithm which makes use of feature selection and statistical novelty detection approaches based on kernel methods. The video stream is independently segmented to detect changes in motion activity, as well as shot boundaries. Based on this two-level segmentation of both streams, four audio-visual correlation measures are computed. The usefulness of these correlation measures is illustrated by a query by video experiment on a 100 music video database, which also exhibits interesting genre dependencies.

langue originaleAnglais
Pages (de - à)347-355
Nombre de pages9
journalIEEE Transactions on Circuits and Systems for Video Technology
Volume17
Numéro de publication3
Les DOIs
étatPublié - 1 mars 2007
Modification externeOui

Empreinte digitale

Examiner les sujets de recherche de « On the correlation of automatic audio and visual segmentations of music videos ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation