Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-23T09:32:50.623Z Has data issue: false hasContentIssue false
  • English
  • Français

A Note on Approximating Mean Occupation Times of Continuous-Time Markov Chains

Published online by Cambridge University Press:  27 July 2009

Sheldon M. Ross
Sheldon M. Ross
Affiliation:
Department of Industrial Engineering and Operations Research University of California, Berkeley, California 94720
Get access Rights & Permissions [Opens in a new window]

Extract

In [1] an approach to approximate the transition probabilities and mean occupation times of a continuous-time Markov chain is presented. For the chain under consideration, let Pij(t) and Tij(t) denote respectively the probability that it is in state j at time t, and the total time spent in j by time t, in both cases conditional on the chain starting in state i. Also, let Y1,…, Yn be independent exponential random variables each with rate λ = n/t, which are also independent of the Markov chain.

Type
Articles
Information
Probability in the Engineering and Informational Sciences , Volume 2 , Issue 2 , April 1988 , pp. 267 - 268
Copyright
Copyright © Cambridge University Press 1988

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)