Abstract
In the context of a linear model with a sparse coefficient vector, exponential weights methods have been shown to be achieve oracle inequalities for denoising/prediction. We show that such methods also succeed at variable selection and estimation under the near minimum condition on the design matrix, instead of much stronger assumptions required by other methods such as the Lasso or the Dantzig Selector. The same analysis yields consistency results for Bayesian methods and BIC-type variable selection under similar conditions.
| Original language | English |
|---|---|
| Pages (from-to) | 328-354 |
| Number of pages | 27 |
| Journal | Electronic Journal of Statistics |
| Volume | 8 |
| Issue number | 1 |
| DOIs | |
| Publication status | Published - 1 Jan 2014 |
| Externally published | Yes |
Keywords
- Estimation
- Exponential weights
- Gibbs sampler
- Identifiability con- dition
- Model selection
- Sparse linear model
- Variable selection
Fingerprint
Dive into the research topics of 'Estimation and variable selection with exponential weights'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver