Skip to main navigation Skip to search Skip to main content

Your Diffusion Model is an Implicit Synthetic Image Detector

  • Centre national de la recherche scientifique

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recent developments in diffusion models, particularly with latent diffusion and classifier-free guidance, have produced highly realistic images that can deceive humans. In the detection domain, the need for generalization across diverse generative models has led many to rely on frequency fingerprints or traces for identifying synthetic images therefore often compromising the robustness against complex image degradations. In this paper, we propose a novel approach that does not rely on frequency or direct image-based features. Instead, we leverage pre-trained diffusion models and a sampling technique to detect fake images. Our methodology is based on two key insights: (i) pre-trained diffusion models already contain rich information about the real data distribution, enabling the differentiation between real and fake images through strategic sampling; (ii) the dependency of textual conditional diffusion models on classifier-free guidance, coupled with higher guidance weights, enforces the discernibility between real and diffusion generated fake images. We evaluate our method across the GenImage dataset, with eight distinct image generators and various image degradations. Our method demonstrates its efficacy and robustness in detecting multiple types of AI-generated synthetic images, setting the new state of the art. Code is available on our project page (https://www.lix.polytechnique.fr/vista/projects/2024_detector_wang).

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2024 Workshops, Proceedings
EditorsAlessio Del Bue, Cristian Canton, Jordi Pont-Tuset, Tatiana Tommasi
PublisherSpringer Science and Business Media Deutschland GmbH
Pages418-434
Number of pages17
ISBN (Print)9783031926471
DOIs
Publication statusPublished - 1 Jan 2025
EventWorkshops that were held in conjunction with the 18th European Conference on Computer Vision, ECCV 2024 - Milan, Italy
Duration: 29 Sept 20244 Oct 2024

Publication series

NameLecture Notes in Computer Science
Volume15643 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceWorkshops that were held in conjunction with the 18th European Conference on Computer Vision, ECCV 2024
Country/TerritoryItaly
CityMilan
Period29/09/244/10/24

Fingerprint

Dive into the research topics of 'Your Diffusion Model is an Implicit Synthetic Image Detector'. Together they form a unique fingerprint.

Cite this