Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-23T05:32:19.787Z Has data issue: false hasContentIssue false
  • English
  • Français

Integral representations of transition probabilities and serial covariances of certain markov chains

Published online by Cambridge University Press:  14 July 2016

D. J. Daley
D. J. Daley*
Affiliation:
Statistical Laboratory, University of Cambridge
Get access Rights & Permissions [Opens in a new window]

Abstract

This note is concerned with integral representations of some transition probabilities of countable state space Markov chains embedded in birth and death processes, of the serial covariances of functions defined on such chains when stationary, and finally the properties of the spectral measure of stationary processes with monotonically decreasing or completely monotonic serial covariances.

Type
Research Papers
Information
Journal of Applied Probability , Volume 6 , Issue 3 , December 1969 , pp. 648 - 659
Copyright
Copyright © Applied Probability Trust 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Benes, V. E. (1957) On queues with Poisson arrivals. Ann. Math. Statist. 28, 670–677.Google Scholar
[2] Daley, D. J. (1968) The serial correlation coefficients of waiting times in a stationary single server queue. J. Aust. Math. Soc. 8, 683–699.Google Scholar
[3] Daley, D. J. (1968) Stochastically monotone Markov chains. Z. Wahrscheinlichkeitsth. 10, 305–317.Google Scholar
[4] Daley, D. J. (1967) Some Aspects of Markov Chains in Queueing Theory and Epidemiology. Unpublished Ph. D. dissertation, University of Cambridge.Google Scholar
[5] Doob, J. L. (1953) Stochastic Processes. Wiley, New York.Google Scholar
[6] Feller, W. (1966) An Introduction to Probability Theory and its Applications, Vol. II. Wiley, New York.Google Scholar
[7] Feller, W. (1966) On the Fourier representation for Markov chains and the strong ratio theorem. J. Math. Mech. 15, 273–283.Google Scholar
[8] Karlin, S. and Mcgregor, J. (1957) The differential equations of birth-and-death processes, and the Stieltjes moment problem. Trans. Amer. Math. Soc. 85, 489–546.Google Scholar
[9] Karlin, S. and Mcgregor, J. (1958) Many server queueing processes with Poisson input and exponential service times. Pacific J. Math. 8, 87–118.Google Scholar
[10] Karlin, S. and Mcgregor, J. (1959) Random walks. Illinois J. Math. 3, 66–81.Google Scholar
[11] Karlin, S. and Mcgregor, J. (1966) Spectral theory of branching processes, I and II. Z. Wahrscheinlichkeitsth. 5, 6–33 and 34–54.CrossRefGoogle Scholar
[12] Kendall, D. G. (1959) Unitary dilations of one-parameter semigroups of Markov transition operators, and the corresponding integral representations for Markov processes with a countable infinity of states. Proc. Lond. Math. Soc. 9, 417–431.Google Scholar
[13] Kendall, D. G. (1959) Unitary dilations of Markov transition operators and the corresponding integral representations for transition probabilities. Surveys in Probability and Statistics. 139–161. Almqvist and Wiksell, Stockholm.Google Scholar
[14] Kingman, J. F. C. (1966) An approach to the study of Markov processes (with Discussion). J. R. Statist. Soc. B 28, 417–447.Google Scholar
[15] Pakes, A. G. (1969) The correlation coefficients of the queue lengths of some stationary single server queues. (Submitted for publication).Google Scholar
[16] Reuter, G. E. H. (1957) Denumerable Markov processes and the associated contraction semigroups on l. Acta Math. 97, 1–46.Google Scholar
[17] Reynolds, J. F. (1968) On the autocorrelation and spectral functions of queues. J. Appl. Prob. 5, 467–475.CrossRefGoogle Scholar
[18] Takács, L. (1960) The transient behaviour of a single server queueing process with recurrent input and exponentially distributed service time. Operat. Res. 8, 231–245.Google Scholar
[19] Titchmarsh, E. C. (1937) The Theory of Fourier Integrals. Oxford University Press, Oxford.Google Scholar
[20] Vere-Jones, D. (1963) Spectral properties of some operators associated with queueing systems. Z. Wahrscheinlichkeitsth. 2, 12–21.CrossRefGoogle Scholar
[21] Zygmund, A. (1935) Trigonometrical Series. Cambridge University Press, Cambridge.Google Scholar
[22] Rosenblatt, M. (1961) Independence and dependence. Proc. Fourth Berkeley Symp., Volume II, 431–443.Google Scholar