Hostname: page-component-586b7cd67f-dlnhk Total loading time: 0 Render date: 2024-11-22T21:09:17.111Z Has data issue: false hasContentIssue false
  • English
  • Français

Computable Bounds on the Spectral Gap for Unreliable Jackson Networks

Part of: Markov processes Special processes

Published online by Cambridge University Press:  22 February 2016

Paweł Lorek  and
Ryszard Szekli
Paweł Lorek*
Affiliation:
University of Wrocław
Ryszard Szekli*
Affiliation:
University of Wrocław
*
∗ Postal address: Mathematical Institute, University of Wroclaw, pl. Grunwaldzki 2/4, 50-384 Wrocław, Poland.
∗ Postal address: Mathematical Institute, University of Wroclaw, pl. Grunwaldzki 2/4, 50-384 Wrocław, Poland.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

The goal of this paper is to identify exponential convergence rates and to find computable bounds for them for Markov processes representing unreliable Jackson networks. First, we use the bounds of Lawler and Sokal (1988) in order to show that, for unreliable Jackson networks, the spectral gap is strictly positive if and only if the spectral gaps for the corresponding coordinate birth and death processes are positive. Next, utilizing some results on birth and death processes, we find bounds on the spectral gap for network processes in terms of the hazard and equilibrium functions of the one-dimensional marginal distributions of the stationary distribution of the network. These distributions must be in this case strongly light-tailed, in the sense that their discrete hazard functions have to be separated from 0. We relate these hazard functions with the corresponding networks' service rate functions using the equilibrium rates of the stationary one-dimensional marginal distributions. We compare the obtained bounds on the spectral gap with some other known bounds.

Keywords

Unreliable Jackson networkspectral gapexponential ergodicityCheeger's constant

MSC classification

Primary: 60K25: Queueing theory
Secondary: 60J25: Continuous-time Markov processes on general state spaces
Type
Research Article
Information
Advances in Applied Probability , Volume 47 , Issue 2 , June 2015 , pp. 402 - 424
Copyright
© Applied Probability Trust 

Footnotes

The work of both authors was supported by NCN Research Grant DEC-2011/01/B/ST1/01305.

References

Anantharam, V. (1989). Threshold phenomena in the transient behaviour of Markovian models of communication networks and databases. Queueing Systems Theory Appl. 5, 77–98.CrossRefGoogle Scholar
Baxendale, P. H. (2005). Renewal theory and computable convergence rates for geometrically ergodic Markov chains. Ann. Appl. Prob. 15, 700–738.CrossRefGoogle Scholar
Berenhaut, K. S. and Lund, R. (2001). Geometric renewal convergence rates from hazard rates. J. Appl. Prob. 38, 180–194.CrossRefGoogle Scholar
Berenhaut, K. S. and Lund, R (2002). Renewal convergence rates for DHR and NWU lifetimes. Prob. Eng. Inf. Sci. 16, 67–84.CrossRefGoogle Scholar
Blanc, J. P. C. (1985). The relaxation time of two queueing systems in series. Commun. Statist. Stoch. Models 1, 1–16.CrossRefGoogle Scholar
Callaert, H. and Keilson, J. (1973). On exponential ergodicity and spectral structure for birth–death processes. I. Stoch. Process. Appl. 1, 187–216.CrossRefGoogle Scholar
Chafai, D. and Joulin, A. (2013). Intertwining and commutation relations for birth–death processes. Bernoulli 19, 1855–1879.CrossRefGoogle Scholar
Chen, M.-F. (1991). Exponential L 2-convergence and L 2-spectral gap for Markov processes. Acta Math. Sinica (N.S.) 7, 19–37.Google Scholar
Chen, M.-F. (1996). Estimation of spectral gap for Markov chains. Acta Math. Sinica (N.S.) 12, 337–360.Google Scholar
Chen, M.-F. (2005). Eigenvalues, Inequalities, and Ergodic Theory. Springer, London.Google Scholar
Chen, M.-F. (2010). Speed of stability for birth–death processes. Front. Math. China 5, 379–515.CrossRefGoogle Scholar
Daduna, H. and Szekli, R. (1995). Dependencies in Markovian networks. Adv. Appl. Prob. 27, 226–254.CrossRefGoogle Scholar
Daduna, H. and Szekli, R. (1996). A queueing theoretical proof of increasing property of Pólya frequency functions. Statist. Prob. Lett. 26, 233–242.CrossRefGoogle Scholar
Daduna, H. and Szekli, R. (2008). Impact of routeing on correlation strength in stationary queueing network processes. J. Appl. Prob. 45, 846–878.CrossRefGoogle Scholar
Daduna, H., Kulik, R., Sauer, C. and Szekli, R. (2006). Dependence ordering for queueing networks with breakdown and repair. Prob. Eng. Inf. Sci. 20, 575–594.CrossRefGoogle Scholar
Diaconis, P. and Fill, J. A. (1990). Examples for the theory of strong stationary duality with countable state spaces. Prob. Eng. Inf. Sci. 4, 157–180.CrossRefGoogle Scholar
Diaconis, P. and Fill, J. A. (1990). Strong stationary times via a new form of duality. Ann. Prob. 18, 1483–1522.CrossRefGoogle Scholar
Diaconis, P. and Miclo, L. (2009). On times to quasi-stationarity for birth and death processes. J. Theoret. Prob. 22, 558–586.CrossRefGoogle Scholar
Diaconis, P. and Stroock, D. (1991). Geometric bounds for eigenvalues of Markov chains. Ann. Appl. Prob. 1, 36–61.CrossRefGoogle Scholar
Dieker, A. B. and Warren, J. (2010). Series Jackson networks and noncrossing probabilities. Math. Operat. Res. 35, 257–266.CrossRefGoogle Scholar
Fayolle, G., Malyshev, V. A., Meńshikov, M. V. and Sidorenko, A. F. (1993). Lyapounov functions for Jackson networks. Math. Operat. Res. 18, 916–927.CrossRefGoogle Scholar
Fill, J. A. (1991). Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process. Ann. Appl. Prob. 1, 62–87.CrossRefGoogle Scholar
Fill, J. A. (1991). Time to stationarity for a continuous-time Markov chain. Prob. Eng. Inf. Sci. 5, 61–76.CrossRefGoogle Scholar
Fill, J. A. (1992). Strong stationary duality for continuous-time Markov chains. I. Theory. J. Theoret. Prob. 5, 45–70.CrossRefGoogle Scholar
Fill, J. A. (2009). On hitting times and fastest strong stationary times for skip-free and more general chains. J. Theoret. Prob. 22, 587–600.CrossRefGoogle Scholar
Hart, A. G., Martı´nez, S. and San Martin, J. (2003). The λ-classification of continuous-time birth-and-death processes. Adv. Appl. Prob. 35, 1111–1130.CrossRefGoogle Scholar
Hordijk, A. and Spieksma, F. (1992). On ergodicity and recurrence properties of a Markov chain with an application to an open Jackson network. Adv. Appl. Prob. 24, 343–376.CrossRefGoogle Scholar
Ignatiouk-Robert, I. (2006). On the spectrum of Markov semigroups via sample path large deviations. Prob. Theory Relat. Fields 134, 44–80.CrossRefGoogle Scholar
Ignatiouk-Robert, I. and Tibi, D. (2012). Explicit Lyapunov functions and estimates of the essential spectral radius for Jackson networks. Preprint. Available at http://arxiv.org/abs/1206.3066v1.Google Scholar
Iscoe, I. and McDonald, D. (1994). Asymptotics of exit times for Markov Jump processes. II. Applications to Jackson networks. Ann. Prob. 22, 2168–2182.Google Scholar
Kartashov, N. V. (2000). Determination of the spectral index of ergodicity of a birth-and-death process. Ukrainian Math. J. 52, 1018–1028.CrossRefGoogle Scholar
Kijima, M. (1992). Evaluation of the decay parameter for some specialized birth–death processes. J. Appl. Prob. 29, 781–791.CrossRefGoogle Scholar
Kroese, D. P., Scheinhardt, W. R. W. and Taylor, P. G. (2004). Spectral properties of the tandem Jackson network, seen as a quasi-birth-and-death process. Ann. Appl. Prob. 14, 2057–2089.CrossRefGoogle Scholar
Lawler, G. F. and Sokal, A. D. (1988). Bounds on the L 2 spectrum for Markov chains and Markov processes: a generalization of Cheeger's inequality. Trans. Amer. Math. Soc. 309, 557–580.Google Scholar
Liggett, T. M. (1989). Exponential L 2 convergence of attractive reversible nearest particle systems. Ann. Prob. 17, 403–432.CrossRefGoogle Scholar
Liu, W. and Ma, Y. (2009). Spectral gap and convex concentration inequalities for birth–death processes. Ann. Inst. H. Poincaré Prob. Statist. 45, 58–69.CrossRefGoogle Scholar
Lorek, P. and Szekli, R. (2012). Strong stationary duality for Möbius monotone Markov chains. Queueing Systems 71, 79–95.CrossRefGoogle Scholar
Lund, R. B., Meyn, S. P. and Tweedie, R. L. (1996). Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Prob. 6, 218–237.CrossRefGoogle Scholar
Malyshev, V. A. and Spieksma, F. M. (1995). Intrinsic convergence rate of countable Markov chains. Markov Processes Relat. Fields 1, 203–266.Google Scholar
Meyn, S. P. and Tweedie, R. L. (1993). Markov Chains and Stochastic Stability. Springer, London.CrossRefGoogle Scholar
Roberts, G. O. and Tweedie, R. L. (2000). Rates of convergence of stochastically monotone and continuous time Markov models. J. Appl. Prob. 37, 359–373.CrossRefGoogle Scholar
Rolski, T., Schmidli, H., Schmidt, V. and Teugels, J. (1999). Stochastic Processes for Insurance and Finance. John Wiley, Chichester.CrossRefGoogle Scholar
Sauer, C. (2006). Stochastic product form networks with unreliable nodes: analysis of performance and availability. , Hamburg University.Google Scholar
Sauer, C. and Daduna, H. (2003). Availability formulas and performance measures for separable degradable networks. Econom. Quality Control 18, 165–194.Google Scholar
Sirl, D., Zhang, H. and Pollett, P. (2007). Computable bounds for the decay parameter of a birth–death process. J. Appl. Prob. 44, 476–491.CrossRefGoogle Scholar
Van Doorn, E. A. (1981). Stochastic Monotonicity and Queueing Applications of Birth–Death Processes (Lecture Notes Statis. 4). Springer, New York.CrossRefGoogle Scholar
Van Doorn, E. A. (1985). Conditions for exponential ergodicity and bounds for the decay parameter of a birth–death process. Adv. Appl. Prob. 17, 514–530.CrossRefGoogle Scholar
Van Doorn, E. A. (2002). Representations for the rate of convergence of birth–death processes. Theory Prob. Math. Statist. 65, 37–43.Google Scholar
Van Doorn, E. A., Zeifman, A. I. and Panfilova, T. L. (2010). Bounds and asymptotics for the rate of convergence of birth–death processes. Theory Prob. Appl. 54, 97–113.CrossRefGoogle Scholar
Vere-Jones, D. (1963). On the spectra of some linear operators associated with queueing systems. Z. Wahrscheinlichkeitsth. 2, 12–21.CrossRefGoogle Scholar
Wu, L. (2004). Essential spectral radius for Markov semigroups. I. Discrete time case. Prob. Theory Relat. Fields 128, 255–321.CrossRefGoogle Scholar