TY - JOUR
T1 - Distribution Free Tests for Model Selection Based on Maximum Mean Discrepancy with Estimated Parameters
AU - Brück, Florian
AU - Fermanian, Jean David
AU - Min, Aleksey
N1 - Publisher Copyright:
© 2025 Florian Brück, Jean-David Fermanian, Aleksey Min.
PY - 2025/1/1
Y1 - 2025/1/1
N2 - There exist several testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, these testing procedures ignore the presence of estimated parameters in the case of composite null hypotheses. In this paper, we first illustrate the effect of parameter estimation in model specification tests based on the MMD. Second, we propose simple model specification and model selection tests in the case of models with estimated parameters. All our tests are asymptotically standard normal under the null, even when the true underlying distribution belongs to the competing parametric families. A simulation study and a real data analysis illustrate the performance of our tests in terms of power and level.
AB - There exist several testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, these testing procedures ignore the presence of estimated parameters in the case of composite null hypotheses. In this paper, we first illustrate the effect of parameter estimation in model specification tests based on the MMD. Second, we propose simple model specification and model selection tests in the case of models with estimated parameters. All our tests are asymptotically standard normal under the null, even when the true underlying distribution belongs to the competing parametric families. A simulation study and a real data analysis illustrate the performance of our tests in terms of power and level.
KW - distribution free test statistics
KW - maximum mean discrepancy
KW - model comparison
KW - model specification
UR - https://www.scopus.com/pages/publications/105018576333
M3 - Article
AN - SCOPUS:105018576333
SN - 1532-4435
VL - 26
JO - Journal of Machine Learning Research
JF - Journal of Machine Learning Research
ER -