Hostname: page-component-cd9895bd7-p9bg8 Total loading time: 0 Render date: 2024-12-23T05:10:13.501Z Has data issue: false hasContentIssue false
  • English
  • Français

On the existence of uni-instantaneous Q-processes with a given finite μ-invariant measure

Part of: Markov processes

Published online by Cambridge University Press:  14 July 2016

Brenton Gray ,
Phil Pollett  and
Hanjun Zhang
Brenton Gray*
Affiliation:
University of Queensland
Phil Pollett*
Affiliation:
University of Queensland
Hanjun Zhang*
Affiliation:
University of Queensland
*
∗Postal address: Department of Mathematics, University of Queensland, Queensland 4072, Australia.
∗Postal address: Department of Mathematics, University of Queensland, Queensland 4072, Australia.
∗Postal address: Department of Mathematics, University of Queensland, Queensland 4072, Australia.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Let S be a countable set and let Q = (qij, i, j ∈ S) be a conservative q-matrix over S with a single instantaneous state b. Suppose that we are given a real number μ ≥ 0 and a strictly positive probability measure m = (mj, j ∈ S) such that ∑i∈Smiqij = −μmj, j ≠ b. We prove that there exists a Q-process P(t) = (pij(t), i, j ∈ S) for which m is a μ-invariant measure, that is ∑i∈Smipij(t) = e−μtmj, j∈S. We illustrate our results with reference to the Kolmogorov ‘K1’ chain and a birth-death process with catastrophes and instantaneous resurrection.

Keywords

Markov chainq-matrixbirth–death processconstruction theory

MSC classification

Primary: 60J27: Continuous-time Markov processes on discrete state spaces
Secondary: 60J35: Transition functions, generators and resolvents
Type
Research Papers
Information
Journal of Applied Probability , Volume 42 , Issue 3 , September 2005 , pp. 713 - 725
Copyright
© Applied Probability Trust 2005 

References

Anderson, W. J. (1991). Continuous-Time Markov Chains. An Applications-Oriented Approach. Springer, New York.Google Scholar
Chen, A. Y. and Renshaw, E. (1990). Markov branching processes with instantaneous immigration. Prob. Theory Relat. Fields 87, 209–240.Google Scholar
Chen, A. Y. and Renshaw, E. (1993). Existence and uniqueness criteria for conservative uni-instantaneous denumerable Markov processes. Prob. Theory Relat. Fields 94, 427–456.Google Scholar
Chung, K. (1967). Markov Chains with Stationary Transition Probabilities, 2nd edn. Springer, New York.Google Scholar
Kendall, D. G. and Reuter, G. E. H. (1956). Some pathological Markov processes with a denumerable infinity of states and the associated semigroups of operators on l. In Proc. Internat. Congr. Math. 1954, Amsterdam, Vol. 3, Noordhoff, Groningen, pp. 377–415.Google Scholar
Kingman, J. F. C. (1963). The exponential decay of Markov transition probabilities. Proc. London Math. Soc. 13, 337–358.CrossRefGoogle Scholar
Kolmogorov, A. N. (1951). On the differentiability of the transition probabilities in stationary Markov processes with a denumerable number of states. Moskov. Gos. Univ. Učenye Zapiski Mate. 148, 53–59 (in Russian).Google Scholar
Pollett, P. K. (1986). On the equivalence of μ-invariant measures for the minimal process and its q-matrix. Stoch. Process. Appl. 22, 203–221.Google Scholar
Pollett, P. K. (1988). Reversibility, invariance and μ-invariance. Adv. Appl. Prob. 20, 600–621.Google Scholar
Pollett, P. K. (1991). On the construction problem for single-exit Markov chains. Bull. Austral. Math. Soc. 43, 439–450.Google Scholar
Pollett, P. K. and Vere-Jones, D. (1992). A note on evanescent processes. Austral. J. Statist. 34, 531–536.Google Scholar
Reuter, G. E. H. (1959). Denumerable Markov processes. II. J. London Math. Soc. 34, 81–91.Google Scholar
Reuter, G. E. H. (1969). Remarks on a Markov chain example of Kolmogorov. Z. Wahrscheinlichkeitsth. 13, 315–320.CrossRefGoogle Scholar
Tweedie, R. L. (1974). Some ergodic properties of the Feller minimal process. Quart. J. Math. Oxford Ser. 25, 485–495.Google Scholar
Vere-Jones, D. (1967). Ergodic properties of nonnegative matrices. I. Pacific J. Math. 22, 361–386.Google Scholar
Yang, X. Q. (1990). The Construction Theory of Denumerable Markov Processes. John Wiley, Chichester.Google Scholar
Zhang, H. J., Lin, X. and Hou, Z. T. (2001). Invariant distributions of Q-processes. I. Chinese Ann. Math. Ser. A 22, 323–330.Google Scholar
Zhang, H. J., Lin, X. and Hou, Z. T. (2002). Invariant distributions of Q-processes. II. Chinese Ann. Math. Ser. A 23, 361–370.Google Scholar