Hostname: page-component-586b7cd67f-gb8f7 Total loading time: 0 Render date: 2024-11-26T13:46:18.109Z Has data issue: false hasContentIssue false

Boundary problems for additive processes defined on a finite Markov chain

Published online by Cambridge University Press:  24 October 2008

J. Keilson
Affiliation:
University of Birmingham
D. M. G. Wishart
Affiliation:
University of Birmingham

Extract

In a previous paper (3), to which this is a sequel, a central limit theorem was presented for the homogeneous additive processes defined on a finite Markov chain, a class of processes treated extensively by Miller (4). A typical homogeneous process {R(t), X(t)} takes its values in the space

and is described by a vector distribution F(x, t) with components

and an increment matrix distribution B(x) governing the transitions. The present paper treats the motion of the process in the same space when its homogeneity is modified by the presence of a set of boundary states in x. Such bounded processes have many applications to the theory of queues, dams, and inventories. Indeed, this paper and its predecessor were motivated initially by a desire to discuss queuing systems with many servers and many service phases. We will treat both absorbing boundaries and associated passage time densities, and reflecting boundaries. For the latter our main objective is an asymptotic discussion of the tails of the ergodic distribution.

Type
Research Article
Copyright
Copyright © Cambridge Philosophical Society 1965

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

(1)Debreu, G. and Herstein, I. N.Non-negative square matrices. Econometrica 21 (1953), 597607.CrossRefGoogle Scholar
(2)Keilson, J.An alternative to Wiener-Hopf methods for the study of bounded processes. J. Appl. Probability 1 (1964), 85120.Google Scholar
(3)Keilson, J. and Wishart, D. M. G.A central limit theorem for processes defined on a finite Markov chain. Proc. Cambridge Philos. Soc. 60 (1964), 547567.Google Scholar
(4)Miller, H. D.A convexity property in the theory of random variables denned on a finite Markov chain. Ann. Math. Statist. 32 (1961), 12601270.Google Scholar
(5)Pyke, R.Markov renewal processes with finitely many states. Ann. Math. Statist. 32 (1961), 12431259.Google Scholar
(6)Widder, D. V.The Laplace Transform (Princeton, 1946).Google Scholar