Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-25T23:02:58.971Z Has data issue: false hasContentIssue false
  • English
  • Français

On Null-Recurrent Markov Chains

Published online by Cambridge University Press:  20 November 2018

John Lamperti
John Lamperti*
Affiliation:
Stanford University
Rights & Permissions [Opens in a new window]

Extract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Throughout this paper, the symbol P = [Pij] will represent the transition probability matrix of an irreducible, null-recurrent Markov process in discrete time. Explanation of this terminology and basic facts about such chains may be found in (6, ch. 15). It is known (3) that for each such matrix P there is a unique (except for a positive scalar multiple) positive vector Q = {qi} such that QP = Q, or

1

this vector is often called the "invariant measure" of the Markov chain.

The first problem to be considered in this paper is that of determining for which vectors U(0) = {μi(0)} the vectors U(n) converge, or are summable, to the invariant measure Q, where U(n) = U(0)Pn has components

2

In § 2, this problem is attacked for general P. The main result is a negative one, and shows how to form U(0) for which U(n) will not be (termwise) Abel summable.

Type
Research Article
Information
Canadian Journal of Mathematics , Volume 12 , 1960 , pp. 278 - 288
Copyright
Copyright © Canadian Mathematical Society 1960

References

1. Banach, S., Théorie des Opérations Linéaires (Warsaw, 1932).Google Scholar
2. Chung, K.L., Contributions to the theory of Markov chain I, J. Res. Nat. Bu. Stan., 50 (1953), 203–208.Google Scholar
3. Derman, C., A solution to a set of fundamental equations in Markov chains, Proc. Amer. Math. Soc, 5 (1954), 332–334.Google Scholar
4. Derman, C. Some contributions to the theory of denumerable Markov chains, Trans. Amer. Math. Soc, 79 (1955), 541–555.Google Scholar
5. Dobrusin, R.L., On Poisson's law for the distribution of particles in space, Ukrain. Mat. Z., 8 (1956), 127–134. (In Russian; see also Math. Rev., 18, p. 341.)Google Scholar
6. Feller, W., An introduction to probability theory (New York, 1950).Google Scholar
7. Karlin, S. and McGregor, J., Random walks. 111. J. Math., 3 (1959), 66–81.Google Scholar
8. Maruyama, G., On the Poisson distribution derived from independent random walks, Nat. Sci. Rep. Ochanomizu Univ., 6 (1955), 1–6.Google Scholar
9. Watanabe, H., On the Poisson distribution, J. Math. Soc. Japan, 8 (1956), 127–134.Google Scholar