Skip to main navigation Skip to search Skip to main content

Further and stronger analogy between sampling and optimization: Langevin Monte Carlo and gradient descent

  • ENSAE

Research output: Contribution to journalConference articlepeer-review

Abstract

In this paper, we revisit the recently established theoretical guarantees for the convergence of the Langevin Monte Carlo algorithm of sampling from a smooth and (strongly) log-concave density. We improve the existing results when the convergence is measured in the Wasserstein distance and provide further insights on the very tight relations between, on the one hand, the Langevin Monte Carlo for sampling and, on the other hand, the gradient descent for optimization. Finally, we also establish guarantees for the convergence of a version of the Langevin Monte Carlo algorithm that is based on noisy evaluations of the gradient.

Original languageEnglish
Pages (from-to)678-689
Number of pages12
JournalProceedings of Machine Learning Research
Volume65
Publication statusPublished - 1 Jan 2017
Externally publishedYes
Event30th Conference on Learning Theory, COLT 2017 - Amsterdam, Netherlands
Duration: 7 Jul 201710 Jul 2017

Keywords

  • Approximate sampling
  • Gradient descent
  • Langevin algorithm
  • Markov Chain Monte Carlo
  • Rates of convergence

Fingerprint

Dive into the research topics of 'Further and stronger analogy between sampling and optimization: Langevin Monte Carlo and gradient descent'. Together they form a unique fingerprint.

Cite this