Skip to main navigation Skip to search Skip to main content

Sliced-Wasserstein Flows: Nonparametric Generative Modeling via Optimal Transport and Diffusions

  • Antoine Liutkus
  • , Umut Şimşekli
  • , Szymon Majewski
  • , Alain Durmus
  • , Fabian Robert Stöter
  • DALI/LIRMM
  • Université Paris-Saclay
  • Institute of Mathematics of the Polish Academy of Sciences
  • ENS Paris-Saclay

Research output: Contribution to journalConference articlepeer-review

Abstract

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of complicated datasets and sampling from them. The proposed algorithm is based on a functional optimization problem, which aims at finding a measure that is close to the data distribution as much as possible and also expressive enough for generative modeling purposes. We formulate the problem as a gradient flow in the space of probability measures. The connections between gradient flows and stochastic differential equations let us develop a computationally efficient algorithm for solving the optimization problem. We provide formal theoretical analysis where we prove finitetime error guarantees for the proposed algorithm. To the best of our knowledge, the proposed algorithm is the first nonparametric IGM algorithm with explicit theoretical guarantees. Our experimental results support our theory and show that our algorithm is able to successfully capture the structure of different types of data distributions.

Original languageEnglish
Pages (from-to)4104-4113
Number of pages10
JournalProceedings of Machine Learning Research
Volume97
Publication statusPublished - 1 Jan 2019
Externally publishedYes
Event36th International Conference on Machine Learning, ICML 2019 - Long Beach, United States
Duration: 9 Jun 201915 Jun 2019

Fingerprint

Dive into the research topics of 'Sliced-Wasserstein Flows: Nonparametric Generative Modeling via Optimal Transport and Diffusions'. Together they form a unique fingerprint.

Cite this