Relative entropy and waiting times for continuous-time markov processes

Research output: Contribution to journalArticlepeer-review

Abstract

For discrete-time stochastic processes, there is a close connection between return (resp. waiting) times and entropy (resp. relative entropy). Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one needs a reference measure on path space and so the natural object is relative entropy rather than entropy. In this paper we elaborate on this in the case of continuous-time Markov processes with finite state space. A reference measure of special interest is the one associated to the time-reversed process. In that case relative entropy is interpreted as the entropy production rate. The main results of this paper are: almost-sure convergence to relative entropy of the logarithm of waiting-times ratios suitably normalized, and their fluctuation properties (central limit theorem and large deviation principle).

Original languageEnglish
Pages (from-to)1049-1068
Number of pages20
JournalElectronic Journal of Probability
Volume11
DOIs
Publication statusPublished - 1 Jan 2006

Keywords

  • Central limit theorem
  • Continuous-time Markov chain
  • Entropy production
  • Large deviations
  • Law of large numbers
  • Time-reversed process

Fingerprint

Dive into the research topics of 'Relative entropy and waiting times for continuous-time markov processes'. Together they form a unique fingerprint.

Cite this