No CrossRef data available.
Article contents
A first-passage problem for a two-dimensional controlled random walk
Published online by Cambridge University Press: 14 July 2016
Abstract
The process of interest is a controlled random walk in two dimensions: whenever the walker is above the main diagonal, the next increment to his position is chosen from a distribution FA; whenever the walker is below the diagonal, the next increment comes from another distribution FB. The two distributions have mean vectors which tend to push the walker back toward the diagonal. We analyze the problem of first passage to the first quadrant, obtaining explicit representations for the limiting first-entry distribution and expected first-passage time.
- Type
- Research Paper
- Information
- Copyright
- Copyright © Applied Probability Trust 1986
References
Athreya, K. B., Mcdonald, D. and Ney, P. (1978) Limit theorems for semi-Markov processes and renewal theory for Markov chains. Ann. Prob.
6, 788–797.Google Scholar
Chernoff, H. (1959) Sequential design for experiments. Ann. Math. Statist.
30, 755–770.Google Scholar
Feller, W. (1966) An Introduction to Probability Theory and its Applications, Vol. II. Wiley, New York.Google Scholar
Keener, R. (1984) Second order efficiency in the sequential design of experiments. Ann. Statist.
12, 510–532.CrossRefGoogle Scholar
Kesten, H. (1974) Renewal theory for functionals of Markov chains with general state space. Ann. Prob.
2, 355–386.Google Scholar
Lalley, S. and Lorden, G. (1986) A control problem arising in the sequential design of experiments. Ann. Prob.
14.Google Scholar
Orey, S. (1961) Change of time scale for Markov processes. Trans. Amer. Math. Soc.
99, 384–390.Google Scholar