Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-22T14:29:56.561Z Has data issue: false hasContentIssue false

Quasi–stationary distributions in Markov population processes

Published online by Cambridge University Press:  01 July 2016

Andrew D. Barbour*
Affiliation:
University of Cambridge

Abstract

One way of analysing complicated Markov population processes is to approximate them by a diffusion about the deterministic path. This approximation alone may not, however, answer all the questions which might reasonably be asked. Many processes have phases, for example near boundaries, where a different approximation is required; such processes are better described by a succession of diffusion and special approximations alternately.

This paper looks at the special treatment required near a point where the deterministic equations are in equilibrium. When the equilibrium is unstable, the process will eventually wander off, and possibly follow a diffusion around another deterministic path. If the equilibrium is stable, the process will behave as if in stable equilibrium about it for a very much longer time, but may at last be trapped away from it, for instance in an absorbing state. The results presented describe the distributions of the time and place of leaving neighbourhoods of the equilibrium point. The neighbourhoods considered are large enough, in the unstable case, to make possible the link with the next phase of motion. In the stable case, exit times are shown to be so long that the possibility of exit can often be ignored in practice, and the quasi-equilibrium distribution treated as a true equilibrium. A more detailed result, showing how closely the normal approximation holds in this situation, is also provided.

Type
Research Article
Copyright
Copyright © Applied Probability Trust 1976 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Abramowitz, M. and Stegun, I. A. (1965) Handbook of Mathematical Functions. Dover, New York.Google Scholar
[2] Barbour, A. D. (1972) The principle of the diffusion of arbitrary constants. J. Appl. Prob. 9, 519541.CrossRefGoogle Scholar
[3] Barbour, A. D. (1973) Limit Theorems for Markov Population Processes. Ph.D. thesis, University of Cambridge.Google Scholar
[4] Barbour, A. D. (1974) On a functional central limit theorem for Markov population processes. Adv. Appl. Prob. 6, 2139.CrossRefGoogle Scholar
[5] Barbour, A. D. (1975) The duration of the closed stochastic epidemic. Biometrika 62, 477482.Google Scholar
[6] Bartlett, M. S. (1960) Stochastic Population Models in Ecology and Epidemiology. Methuen, London.Google Scholar
[7] Chung, K. L. (1968) A Course in Probability Theory. Harcourt, Brace and World, New York.Google Scholar
[8] Daley, D. J. and Kendall, D. G. (1965) Stochastic rumours. J. Inst. Math. Appl. 1, 4255.CrossRefGoogle Scholar
[9] Feller, W. (1970) An Introduction to Probability Theory and its Applications, Vol. II, 2nd ed. Wiley, New York.Google Scholar
[10] Kurtz, T. G. (1971) Limit theorems for sequences of jump Markov processes approximating ordinary differential processes. J. Appl. Prob. 8, 344356.CrossRefGoogle Scholar
[11] McNeil, D. R. and Schach, S. (1973) Central limit analogues for Markov population processes. J. R. Statist. Soc. B 35, 123.Google Scholar
[12] Nagaev, A. V. and Startsev, A. N. (1970) The asymptotic analysis of a stochastic model of an epidemic. Theor. Prob. Appl. 15, 98107.CrossRefGoogle Scholar
[13] Reuter, G. E. H. (1961) Competition processes. Proc. 4th Berkley Symp. Math. Statist. Prob. 2, 421430.Google Scholar
[14] Ridler-Rowe, C. J. (1964) Some Two-Dimensional Markov Processes. Ph.D. thesis, University of Durham.Google Scholar