TY - GEN
T1 - Recursive computation of the score and observed information matrix in hidden Markov models
AU - Cappé, Olivier
AU - Moulines, Eric
PY - 2005/1/1
Y1 - 2005/1/1
N2 - Hidden Markov Models (henceforth abbreviated to HMMs), taken in their most general acception, that is, including models in which the state space of the hidden chain is continuous, have become a widely used class of statistical models with applications in diverse areas such as communications, engineering, bioinformatics, econometrics and many more. This contribution focus on the computation of derivatives of the log-likelihood and proposes a (comparatively!) simple and general framework, based on the use of Fisher and Louis identities, to obtain recursive equations for computing the score and observed information matrix. This approach is thought to be simpler than (although equivalent to) the solution provided by the so-called sensitivity equations. It is based on the original remark that recursive smoothers for HMMs are also available for some functionals of the hidden states which do not reduce to sum functionals. This view of the problem also suggests ways in which these exact equations could be approximated using sequential Monte Carlo methods.
AB - Hidden Markov Models (henceforth abbreviated to HMMs), taken in their most general acception, that is, including models in which the state space of the hidden chain is continuous, have become a widely used class of statistical models with applications in diverse areas such as communications, engineering, bioinformatics, econometrics and many more. This contribution focus on the computation of derivatives of the log-likelihood and proposes a (comparatively!) simple and general framework, based on the use of Fisher and Louis identities, to obtain recursive equations for computing the score and observed information matrix. This approach is thought to be simpler than (although equivalent to) the solution provided by the so-called sensitivity equations. It is based on the original remark that recursive smoothers for HMMs are also available for some functionals of the hidden states which do not reduce to sum functionals. This view of the problem also suggests ways in which these exact equations could be approximated using sequential Monte Carlo methods.
KW - Hidden Markov models
KW - Information matrix
KW - Recursive computation
KW - Score
KW - Smoothing
UR - https://www.scopus.com/pages/publications/33947138238
U2 - 10.1109/ssp.2005.1628685
DO - 10.1109/ssp.2005.1628685
M3 - Conference contribution
AN - SCOPUS:33947138238
SN - 0780394046
SN - 9780780394049
T3 - IEEE Workshop on Statistical Signal Processing Proceedings
SP - 703
EP - 707
BT - 2005 IEEE/SP 13th Workshop on Statistical Signal Processing - Book of Abstracts
PB - IEEE Computer Society
T2 - 2005 IEEE/SP 13th Workshop on Statistical Signal Processing
Y2 - 17 July 2005 through 20 July 2005
ER -