Hostname: page-component-78c5997874-lj6df Total loading time: 0 Render date: 2024-11-16T15:05:57.274Z Has data issue: false hasContentIssue false
  • English
  • Français

Approximating Transition Probabilities and Mean Occupation Times in Continuous-Time Markov Chains

Published online by Cambridge University Press:  27 July 2009

Sheldon M. Ross
Sheldon M. Ross
Affiliation:
Department of Industrial Engineering and Operations ResearchUniversity of California, BerkeleyBerkeley, California 94707
Get access Rights & Permissions [Opens in a new window]

Abstract

In this paper we propose a new approach for estimating the transition probabilities and mean occupation times of continuous-time Markov chains. Our approach is to approximate the probability of being in a state (or the mean time already spent in a state) at time t by the probability of being in that state (or the mean time already spent in that state) at a random time that is gamma distributed with mean t.

Type
Research Article
Information
Probability in the Engineering and Informational Sciences , Volume 1 , Issue 3 , July 1987 , pp. 251 - 264
Copyright
Copyright © Cambridge University Press 1987

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1.Breiman, L. (1968). Probability. Reading, MA: Addison-Wesley.Google Scholar
2.Ross, S. M. (1987). Approximations in renewal theory, Prob. in the Eng. and Inf. Sciences 1:163–174.Google Scholar
3.Ross, S. M. (1982). Stochastic processes. New York: Wiley.Google Scholar