Weakly supervised object detection in artworks

Nicolas Gonthier, Yann Gousseau, Said Ladjal, Olivier Bonfait

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose a method for the weakly supervised detection of objects in paintings. At training time, only image-level annotations are needed. This, combined with the efficiency of our multiple-instance learning method, enables one to learn new classes on-the-fly from globally annotated databases, avoiding the tedious task of manually marking objects. We show on several databases that dropping the instance-level annotations only yields mild performance losses. We also introduce a new database, IconArt, on which we perform detection experiments on classes that could not be learned on photographs, such as Jesus Child or Saint Sebastian. To the best of our knowledge, these are the first experiments dealing with the automatic (and in our case weakly supervised) detection of iconographic elements in paintings. We believe that such a method is of great benefit for helping art historians to explore large digital databases.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2018 Workshops, Proceedings
EditorsStefan Roth, Laura Leal-Taixé
PublisherSpringer Verlag
Pages692-709
Number of pages18
ISBN (Print)9783030110116
DOIs
Publication statusPublished - 1 Jan 2019
Externally publishedYes
Event15th European Conference on Computer Vision, ECCV 2018 - Munich, Germany
Duration: 8 Sept 201814 Sept 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11130 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th European Conference on Computer Vision, ECCV 2018
Country/TerritoryGermany
CityMunich
Period8/09/1814/09/18

Keywords

  • Art analysis
  • Multiple instance learning
  • Transfer learning
  • Weakly supervised detection

Fingerprint

Dive into the research topics of 'Weakly supervised object detection in artworks'. Together they form a unique fingerprint.

Cite this