Passer à la navigation principale Passer à la recherche Passer au contenu principal

DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs

  • Ecole polytechnique
  • Lagrange Mathematics and Computing Research Center
  • ENS Paris-Saclay

Résultats de recherche: Le chapitre dans un livre, un rapport, une anthologie ou une collectionContribution à une conférenceRevue par des pairs

12 Citations (Scopus)

Résumé

Performing reliable Bayesian inference on a big data scale is becoming a keystone in the modern era of machine learning. A workhorse class of methods to achieve this task are Markov chain Monte Carlo (MCMC) algorithms and their design to handle distributed datasets has been the subject of many works. However, existing methods are not completely either reliable or computationally efficient. In this paper, we propose to fill this gap in the case where the dataset is partitioned and stored on computing nodes within a cluster under a master/slaves architecture. We derive a user-friendly centralised distributed MCMC algorithm with provable scaling in high-dimensional settings. We illustrate the relevance of the proposed methodology on both synthetic and real data experiments.

langue originaleAnglais
titreProceedings of the 38th International Conference on Machine Learning, ICML 2021
EditeurML Research Press
Pages8577-8587
Nombre de pages11
ISBN (Electronique)9781713845065
étatPublié - 1 janv. 2021
Evénement38th International Conference on Machine Learning, ICML 2021 - Virtual, Online
Durée: 18 juil. 202124 juil. 2021

Série de publications

NomProceedings of Machine Learning Research
Volume139
ISSN (Electronique)2640-3498

Une conférence

Une conférence38th International Conference on Machine Learning, ICML 2021
La villeVirtual, Online
période18/07/2124/07/21

Empreinte digitale

Examiner les sujets de recherche de « DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation