Passer à la navigation principale Passer à la recherche Passer au contenu principal

Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance

Résultats de recherche: Contribution à un journalArticle de conférenceRevue par des pairs

Résumé

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about the data distribution. In this work, we present a novel framework for analyzing W2-convergence in SGMs, significantly relaxing traditional assumptions such as log-concavity and score regularity. Leveraging the regularization properties of the Ornstein-Uhlenbeck (OU) process, we show that weak log-concavity of the data distribution evolves into log-concavity over time. This transition is rigorously quantified through a PDE-based analysis of the Hamilton-Jacobi-Bellman equation governing the log-density of the forward process. Moreover, we establish that the drift of the time-reversed OU process alternates between contractive and non-contractive regimes, reflecting the dynamics of concavity. Our approach circumvents the need for stringent regularity conditions on the score function and its estimators, relying instead on milder, more practical assumptions. We demonstrate the wide applicability of this framework through explicit computations on Gaussian mixture models, illustrating its versatility and potential for broader classes of data distributions.

langue originaleAnglais
Pages (de - à)55631-55656
Nombre de pages26
journalProceedings of Machine Learning Research
Volume267
étatPublié - 1 janv. 2025
Evénement42nd International Conference on Machine Learning, ICML 2025 - Vancouver, Canada
Durée: 13 juil. 202519 juil. 2025

Empreinte digitale

Examiner les sujets de recherche de « Beyond Log-Concavity and Score Regularity: Improved Convergence Bounds for Score-Based Generative Models in W2-distance ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation