Passer à la navigation principale Passer à la recherche Passer au contenu principal

Statistical efficiency of thompson sampling for combinatorial semi-bandits

  • INRIA Institut National de Recherche en Informatique et en Automatique
  • ENS Paris-Saclay
  • DeepMind Technologies Limited

Résultats de recherche: Contribution à un journalArticle de conférenceRevue par des pairs

23 Citations (Scopus)

Résumé

We investigate stochastic combinatorial multi-armed bandit with semi-bandit feedback (CMAB). In CMAB, the question of the existence of an efficient policy with an optimal asymptotic regret (up to a factor poly-logarithmic with the action size) is still open for many families of distributions, including mutually independent outcomes, and more generally the multivariate sub-Gaussian family. We propose to answer the above question for these two families by analyzing variants of the Combinatorial Thompson Sampling policy (CTS). For mutually independent outcomes in [0, 1], we propose a tight analysis of CTS using Beta priors. We then look at the more general setting of multivariate sub-Gaussian outcomes and propose a tight analysis of CTS using Gaussian priors. This last result gives us an alternative to the Efficient Sampling for Combinatorial Bandit policy (ESCB), which, although optimal, is not computationally efficient.

langue originaleAnglais
journalAdvances in Neural Information Processing Systems
Volume2020-December
étatPublié - 1 janv. 2020
Evénement34th Conference on Neural Information Processing Systems, NeurIPS 2020 - Virtual, Online
Durée: 6 déc. 202012 déc. 2020

Empreinte digitale

Examiner les sujets de recherche de « Statistical efficiency of thompson sampling for combinatorial semi-bandits ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation