Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-29T06:44:29.868Z Has data issue: false hasContentIssue false
  • English
  • Français

Continuous-time monotone stochastic recursions and duality

Part of: Markov processes Special processes Stochastic processes

Published online by Cambridge University Press:  01 July 2016

Karl Sigman  and
Reade Ryan
Karl Sigman*
Affiliation:
Columbia University
Reade Ryan*
Affiliation:
UCLA
*
∗ Postal address: Department of Industrial Engineering and Operations Research, Columbia University, Mudd Bldg, MC: 4704, 500 West 120th Street, New York, NY 10027, USA.
∗∗ Postal address: The Anderson School at UCLA, 110 Westwood Plaza, Los Angeles, CA 90095-1481, USA. Email address: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

A duality is presented for continuous-time, real-valued, monotone, stochastic recursions driven by processes with stationary increments. A given recursion defines the time evolution of a content process (such as a dam or queue), and it is shown that the existence of the content process implies the existence of a corresponding dual risk process that satisfies a dual recursion. The one-point probabilities for the content process are then shown to be related to the one-point probabilities of the risk process. In particular, it is shown that the steady-state probabilities for the content process are equivalent to the first passage time probabilities for the risk process. A number of applications are presented that flesh out the general theory. Examples include regulated processes with one or two barriers, storage models with general release rate, and jump and diffusion processes.

Keywords

Loynes' lemmajump-diffusion processreflected processrisk processruin probabilitySiegmund dualitystationary distributionstationary incrementsstorage processtwo-barrier reflection

MSC classification

Primary: 60G10: Stationary processes 60J60: Diffusion processes 60J75: Jump processes 60K30: Applications (congestion, allocation, storage, traffic, etc.) 60K25: Queueing theory
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 32 , Issue 2 , June 2000 , pp. 426 - 445
Copyright
Copyright © Applied Probability Trust 2000 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Aldous, D. (1988). Brisk applications of Siegmund duality. Unpublished mimeograph. University of California, Berkeley.Google Scholar
[2] Anderson, R. F. and Orey, S. (1976). Small random perturbation of dynamical systems with reflecting boundary. Nagoya Math. J. 60, 189–216.Google Scholar
[3] Asmussen, S. (1995). Stationary distributions via first passage times. In Advances in Queueing, ed. Dshalalow, J. CRC Press, Boca Raton, pp. 79–102.Google Scholar
[4] Asmussen, S. (1995). Stationary distributions for fluid flow models with or without Brownian noise. Stoch. Models 11, 21–49.Google Scholar
[5] Asmussen, S. and Kella, O. (1996). Rate modulation in dams and ruin problems. J. Appl. Prob. 2, 523–535.Google Scholar
[6] Asmussen, S. and Rubinstein, R. (1995). Complexity properties of steady-state rare events simulation in queueing models. In Advances in Queueing, ed. Dshalalow, J. CRC Press, Boca Raton, pp. 429–462.Google Scholar
[7] Asmussen, S. and Schock Petersen, S. (1989). Ruin probabilities expressed in terms of storage processes. Adv. Appl. Prob. 20, 913–916.Google Scholar
[8] Asmussen, S. and Sigman, K. (1996). Monotone stochastic recursions and their duals. PEIS 10, 1–20.Google Scholar
[9] Bardhan, I. and Sigman, K. (1994). Stationary regimes for inventory processes. Stoch. Proc. Appl. 56, 77–86.Google Scholar
[10] Borovkov, A. A. (1976). Stochastic Processess in Queueing Theory. Springer, New York.Google Scholar
[11] Brandt, A., Franken, P. and Lisek, B. (1992). Stationary Stochastic Models. John Wiley, New York.Google Scholar
[12] Dupuis, P. and Ishii, H. (1991). On Lipschitz continuity of the solution mapping to the Skorokhod problem, with applications. Stochastics Stochastics Reports 35, 31–62.Google Scholar
[13] Ethier, S. and Kurtz, T. (1986). Markov Processes, Characterization and Convergence. Wiley Series in Probability and Statistics, John Wiley, New York.Google Scholar
[14] Harrison, J. M. (1985). Brownian Motion and Stochastic Flow Systems. John Wiley, New York.Google Scholar
[15] Harrison, J. M. and Resnick, S. I. (1977). The recurrence classification of risk and storage processes. Math. Operat. Res. 3, 57–66.Google Scholar
[16] Lisek, B. (1982). A method for solving a class of recursive stochastic equations. Z. Wahrscheinlichkeitsth. 60, 151–161.Google Scholar
[17] Loynes, R. (1962). The stability of a queue with non-independent inter-arrival and service times. Proc. Camb. Phil. Soc. 58, 497–520.Google Scholar
[18] Miyazawa, M. (1977). Time and customer processes in queues with stationary inputs. J. Appl. Prob. 14, 349–357.Google Scholar
[19] Pinsky, R. (1995). Positive Harmonic Functions and Diffusion. Cambridge University Press, Cambridge.Google Scholar
[20] Prabhu, N. U. (1961). On the ruin problem of collective risk theory. Ann. Math. Statist. 32, 757–764.Google Scholar
[21] Seal, H. L. (1972). Risk theory and the single server queue. Mitt. Verein Schweiz. Versich. Math. 72, 171–178.Google Scholar
[22] Siegmund, D. (1976). The equivalence of absorbing and reflecting barrier problems for stochastically monotone Markov processes. Ann. Prob. 4, 914–924.Google Scholar
[23] Sigman, K. (1995). Stationary Marked Point Processes: An Intuitive Approach. Chapman and Hall, New York.Google Scholar
[24] Sigman, K. and Yao, D. D. (1994). Finite moments for inventory processes. Ann. Appl. Prob. 4, 765–778.Google Scholar