Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-05T09:58:49.867Z Has data issue: false hasContentIssue false

Exponential ergodicity in derived Markov chains

Published online by Cambridge University Press:  14 July 2016

Jozef L. Teugels*
Affiliation:
University of Louvain, Belgium

Extract

A general proposition is proved stating that the exponential ergodicity of a stationary Markov chain is preserved for derived Markov chains as defined by Cohen [2], [3]. An application to a certain type of continuous time Markov chains is included.

Type
Research Papers
Copyright
Copyright © Applied Probability Trust 1968 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Chung, K. L. (1960) Markov Chains with Stationary Transition Probabilities. Springer Verlag.Google Scholar
[2] Cohen, J. W. (1962) On derived and nonstationary Markov chains. Theor. Prob. Appl. 7, 402423.Google Scholar
[3] Cohen, J. W. (1962) Derived Markov chains. I, II, III. Nederl. Akad. Wetensch. Proc. Ser. A. 65, 5592.Google Scholar
[4] Feller, W. (1966) An Introduction to Probability Theory and its Applications. II. Wiley, New York.Google Scholar
[5] Hille, E. and Phillips, R. S. (1957) Functional analysis and semigroups. Amer. Math. Soc. Coll. Publ. 31.Google Scholar
[6] Karlin, S. (1966) A First Course in Stochastic Processes. Academic Press, New York.Google Scholar
[7] Karlin, S. and Mcgregor, J. L. (1958) Many server queueing processes with Poisson input and exponential service times. Pacific J. Math. 8, 87118.Google Scholar
[8] Kendall, D. G. (1959) Unitary dilations of Markov transition operators and the corresponding integral representation for transition probability matrices. Probability and Statistics. Editor Grenander, U. Almqvist & Wiksell, Stockholm.Google Scholar
[9] Kendall, D. G. (1960) Geometric ergodicity and the theory of queues. Mathematical Methods in the Social Sciences. Editors Arrow, K., Karlin, S., Suppes, P. Stanford University Press, California.Google Scholar
[10] Kingman, J. F. C. (1963) The exponential decay of Markov transition probabilities. Proc. Lond. Math. Soc. 13, 337358.CrossRefGoogle Scholar
[11] Kingman, J. F. C. (1963) Ergodic properties of continuous-time Markov processes and their discrete skeletons. Proc. Lond. Math. Soc. 13, 593604.Google Scholar
[12] Miller, H. D. (1966) Geometric ergodicity in a class of denumerable Markov chains. Z. Wahrscheinlichkeitsth. 4, 354373.Google Scholar
[13] Teugels, J. L. (1967) On the rate of convergence in renewal and Markov renewal processes. Mimeo Series 107, Department of Statistics, Purdue University.Google Scholar
[14] Vere-Jones, D. (1962) Geometric ergodicity in denumerable Markov chains. Quart. J. Math. 13, 728.Google Scholar