Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-23T13:50:52.632Z Has data issue: false hasContentIssue false
  • English
  • Français

On the time a Markov chain spends in a lumped state

Part of: Markov processes Distribution theory - Probability

Published online by Cambridge University Press:  14 July 2016

Tommy Norberg
Tommy Norberg*
Affiliation:
Chalmers University
*
∗Postal address: Department of Mathematics, Chalmers University of Technology and Göteborg University, S-41296 Göteborg, Sweden.
Get access Rights & Permissions [Opens in a new window]

Abstract

The sojourn time that a Markov chain spends in a subset E of its state space has a distribution that depends on the hitting distribution on E and the probabilities (resp. rates in the continuous-time case) that govern the transitions within E. In this note we characterise the set of all hitting distributions for which the sojourn time distribution is geometric (resp. exponential).

Keywords

SOJOURN TIMELUMPED CHAIN

MSC classification

Primary: 60J10: Markov chains (discrete-time Markov processes on discrete state spaces) 60J27: Continuous-time Markov processes on discrete state spaces
Secondary: 60E99: None of the above, but in this section
Type
Research Article
Information
Journal of Applied Probability , Volume 34 , Issue 2 , June 1997 , pp. 340 - 345
Copyright
Copyright © Applied Probability Trust 1997 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Research supported in part by the Swedish Natural Science Research Council.

Partly completed while visiting the Center for Stochastic Processes, University of North Carolina at Chapel Hill.

References

[1] Kemeny, J. G. and Snell, J. L. (1976) Finite Markov Chains. Springer, Berlin.Google Scholar
[2] Ledoux, J. (1993) A necessary condition for weak lumpability in finite Markov processes. Operat. Res. Lett. 13, 165–168.Google Scholar
[3] Neuts, M. F. (1981) Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Johns Hopkins University Press, Baltimore.Google Scholar
[4] Rubino, G. and Sericola, B. (1989) On weak lumpability in Markov chains. J. Appl. Prob. 26, 446–457.Google Scholar
[5] Rubino, G. and Sericola, B. (1989) Sojourn times in finite Markov processes. J. Appl. Prob. 27, 744–756.Google Scholar
[6] Rubino, G. and Sericola, B. (1991) A finite characterization of weak lumpable Markov processes. Part I: The discrete time case. Stoch. Proc. Appl. 38, 195–204.Google Scholar
[7] Seneta, E. (1981) Non-Negative Matrices and Markov Chains. Springer, Berlin.Google Scholar