Skip to main navigation Skip to search Skip to main content

A Specialized Semismooth Newton Method for Kernel-Based Optimal Transport

  • Massachusetts Institute of Technology
  • Apple Computer
  • University of California, Berkeley

Research output: Contribution to journalConference articlepeer-review

Abstract

Kernel-based optimal transport (OT) estimators offer an alternative, functional estimation procedure to address OT problems from samples. Recent works suggest that these estimators are more statistically efficient than plug-in (linear programming-based) OT estimators when comparing probability measures in high-dimensions (Vacher et al., 2021). Unfortunately, that statistical benefit comes at a very steep computational price: because their computation relies on the short-step interior-point method (SSIPM), which comes with a large iteration count in practice, these estimators quickly become intractable w.r.t. sample size n. To scale these estimators to larger n, we propose a nonsmooth fixed-point model for the kernel-based OT problem, and show that it can be efficiently solved via a specialized semismooth Newton (SSN) method: We show, exploring the problem’s structure, that the per-iteration cost of performing one SSN step can be significantly reduced in practice. We prove that our SSN method achieves a global convergence rate of O(1/k), and a local quadratic convergence rate under standard regularity conditions. We show substantial speedups over SSIPM on both synthetic and real datasets.

Original languageEnglish
Pages (from-to)145-153
Number of pages9
JournalProceedings of Machine Learning Research
Volume238
Publication statusPublished - 1 Jan 2024
Externally publishedYes
Event27th International Conference on Artificial Intelligence and Statistics, AISTATS 2024 - Valencia, Spain
Duration: 2 May 20244 May 2024

Fingerprint

Dive into the research topics of 'A Specialized Semismooth Newton Method for Kernel-Based Optimal Transport'. Together they form a unique fingerprint.

Cite this