Hostname: page-component-586b7cd67f-rcrh6 Total loading time: 0 Render date: 2024-11-28T15:28:45.866Z Has data issue: false hasContentIssue false
  • English
  • Français

On Separation for Birth-Death Processes

Published online by Cambridge University Press:  27 July 2009

Masaaki Kijima
Masaaki Kijima
Affiliation:
Graduate School of Systems Management, University of Tsukuba, Tokyo, 3-29-1 Otsuka, Bunkyo-ku, Tokyo 112, Japan
Get access Rights & Permissions [Opens in a new window]

Abstract

This article considers separation for a birth-death process on a finite state space S = [1,2,…, N]. Separation is defined by si(t) = 1 – minj∈sPij(t)/πj, as in Fill [5,6], where Pij(t) denotes the transition probabilities of the birth-death process and πj the stationary probabilities. Separation is a measure of nonstationarity of Markov chains and provides an upper bound of the variation distance. Easily computable upper bounds for si-(t) are given, which consist of simple exponential functions whose parameters are the eigenvalues of the infinitesimal generator or its submatrices of the birth-death process.

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 8 , Issue 1 , January 1994 , pp. 51 - 68
Copyright
Copyright © Cambridge University Press 1994

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1.Aldous, D. & Diaconis, P. (1987). Strong uniform times and finite random walks. Advances in Applied Mathematics 8: 69–97.CrossRefGoogle Scholar
2.Barlow, R.E. & Proschan, F. (1965). Mathematical theory of reliability. New York: Wiley.Google Scholar
3.Diaconis, P. & Fill, J.A. (1990). Examples for the theory of strong stationary duality with countable state spaces. Probability in the Engineering and Informational Sciences 4: 157–180.CrossRefGoogle Scholar
4.Diaconis, P. & Fill, J.A. (1990). Strong stationary times via a new form of duality. Annals of Probability 18: 1483–1522.CrossRefGoogle Scholar
5.Fill, J.A. (1991). Time to stationarity for a continuous-time Markov chain. Probability in the Engineering and Informational Sciences 5: 61–76.CrossRefGoogle Scholar
6.Fill, J.A. (1992). Strong stationary duality for continuous-time Markov chains. Part I: Theory. Journal of Theoretical Probability 5: 45–70.CrossRefGoogle Scholar
7.Golub, G.H. & Van Loan, C.F. (1989). Matrix computations, 2nd ed.Baltimore, MD: Johns Hopkins University Press.Google Scholar
8.Karlin, S. (1968). Total positivity. Stanford, CA: Stanford University Press.Google Scholar
9.Karlin, S. & McGregor, J.L. (1957). The differential equations of birth-and-death processes, and the Stieltjes moment problem. Transactions of the American Mathematical Society 85: 489–546.CrossRefGoogle Scholar
10.Keilson, J. (1979). Markov chain models–Rarity and exponentiality. New York: Springer.CrossRefGoogle Scholar
11.Keilson, J. (1981). On the unimodality of passage time densities in birth-death processes. Statistica Neerlandica 25: 49–55.CrossRefGoogle Scholar
12.Keilson, J. & Kester, A. (1977). Monotone matrices and monotone Markov processes. Stochastic Processes and Their Applications 5: 231–241.CrossRefGoogle Scholar
13.Keilson, J. & Kester, A. (1978). Unimodality preservation in Markov chains. Stochastic Processes and Their Applications 7: 179–190.CrossRefGoogle Scholar
14.Kijima, M. (1987). Spectral structure of the first-passage-time densities for classes of Markov chains. Journal of Applied Probability 24: 631–643.CrossRefGoogle Scholar
15.Kijima, M. (1988). Distribution properties of discrete characteristics in M/G/1 and GI/M/1 queues. Journal of the Operations Research Society of Japan 31: 172–189.CrossRefGoogle Scholar
16.Kijima, M. (1989). Upper bounds of a measure of dependence and the relaxation time for finite state Markov chains. Journal of the Operations Research Society of Japan 32: 93–102.CrossRefGoogle Scholar
17.Kijima, M. (1990). On the unimodality of transition probabilities in Markov chains. Australian Journal of Statistics 32: 1–10.CrossRefGoogle Scholar
18.Kijima, M. (1992). Evaluation of the decay parameter for some specialized birth-death processes. Journal of Applied Probability 29: 781–791.CrossRefGoogle Scholar
19.Kijima, M. (1992). Further monotonicity properties of renewal processes. Advances in Applied Probability 24: 575–588.CrossRefGoogle Scholar
20.Matthews, P. (1992). Strong stationary times and eigenvalues. Journal of Applied Probability 29: 228–233.CrossRefGoogle Scholar
21.Stoyan, D. (1983). Comparison methods for queues and other stochastic models. New York: Wiley.Google Scholar
22.Sumita, U. & Kijima, M. (1988). Theory and algorithms of the Laguerre transform, part I: Theory. Journal of the Operations Research Society of Japan 31: 467–494.CrossRefGoogle Scholar
23.Sumita, U. & Kijima, M. (1991). Theory and algorithms of the Laguerre transform, part II: Algorithms. Journal of the Operations Research Society of Japan 34: 449–477.CrossRefGoogle Scholar