Skip to main navigation Skip to search Skip to main content

Non-asymptotic convergence bounds for Sinkhorn iterates and their gradients: a coupling approach

  • Technical University of Eindhoven
  • École Polytechnique

Research output: Contribution to journalConference articlepeer-review

Abstract

Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement efficient and practical algorithmic solutions, even in high dimensional settings. This formulation, also known as the Schrödinger Bridge problem, notably connects with Stochastic Optimal Control (SOC) and can be solved with the popular Sinkhorn algorithm. In the case of discrete-state spaces, this algorithm is known to have exponential convergence; however, achieving a similar rate of convergence in a more general setting is still an active area of research. In this work, we analyze the convergence of the Sinkhorn algorithm for probability measures defined on the d-dimensional torus TdL, that admit densities with respect to the Haar measure of TdL. In particular, we prove pointwise exponential convergence of Sinkhorn iterates and their gradient. Our proof relies on the connection between these iterates and the evolution along the Hamilton-Jacobi-Bellman equations of value functions obtained from SOC -problems. Our approach is novel in that it is purely probabilistic and relies on coupling by reflection techniques for controlled diffusions on the torus.

Original languageEnglish
Pages (from-to)716-746
Number of pages31
JournalProceedings of Machine Learning Research
Volume195
Publication statusPublished - 1 Jan 2023
Externally publishedYes
Event36th Annual Conference on Learning Theory, COLT 2023 - Bangalore, India
Duration: 12 Jul 202315 Jul 2023

Keywords

  • Schrödinger bridge
  • Sinkhorn algorithm
  • optimal transport
  • stochastic optimal control

Fingerprint

Dive into the research topics of 'Non-asymptotic convergence bounds for Sinkhorn iterates and their gradients: a coupling approach'. Together they form a unique fingerprint.

Cite this