TY - GEN
T1 - Learning with a Fisher surrogate loss in a small data regime
AU - Djerrab, Mousaab
AU - Garcia, Alexandre
AU - D'Alché-Buc, Florence
N1 - Publisher Copyright:
© ESANN 2018 - Proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning.
PY - 2018/1/1
Y1 - 2018/1/1
N2 - We introduce a novel framework, Output Fisher Embedding Regression (OFER), that uses a Fisher vector representation of output data and provides prediction by solving an appropriate pre-image problem. OFER takes advantage of the implicit structure of the marginal probability distribution of the output to improve performance in prediction. Although the proposed approach is general and versatile, we put a stress on the Gaussian mixture model for modelling the output data and design a closed-form solution for the corresponding pre-image problem. Numerical results on a drug activity prediction task and a semantic multi-class classification show the relevance of the approach in small data regime.
AB - We introduce a novel framework, Output Fisher Embedding Regression (OFER), that uses a Fisher vector representation of output data and provides prediction by solving an appropriate pre-image problem. OFER takes advantage of the implicit structure of the marginal probability distribution of the output to improve performance in prediction. Although the proposed approach is general and versatile, we put a stress on the Gaussian mixture model for modelling the output data and design a closed-form solution for the corresponding pre-image problem. Numerical results on a drug activity prediction task and a semantic multi-class classification show the relevance of the approach in small data regime.
M3 - Conference contribution
AN - SCOPUS:85069531784
T3 - ESANN 2018 - Proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning
SP - 243
EP - 248
BT - ESANN 2018 - Proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning
PB - i6doc.com publication
T2 - 26th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2018
Y2 - 25 April 2018 through 27 April 2018
ER -