Estimation and variable selection with exponential weights

Research output: Contribution to journalArticlepeer-review

Abstract

In the context of a linear model with a sparse coefficient vector, exponential weights methods have been shown to be achieve oracle inequalities for denoising/prediction. We show that such methods also succeed at variable selection and estimation under the near minimum condition on the design matrix, instead of much stronger assumptions required by other methods such as the Lasso or the Dantzig Selector. The same analysis yields consistency results for Bayesian methods and BIC-type variable selection under similar conditions.

Original languageEnglish
Pages (from-to)328-354
Number of pages27
JournalElectronic Journal of Statistics
Volume8
Issue number1
DOIs
Publication statusPublished - 1 Jan 2014
Externally publishedYes

Keywords

  • Estimation
  • Exponential weights
  • Gibbs sampler
  • Identifiability con- dition
  • Model selection
  • Sparse linear model
  • Variable selection

Fingerprint

Dive into the research topics of 'Estimation and variable selection with exponential weights'. Together they form a unique fingerprint.

Cite this