Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-04T19:38:36.694Z Has data issue: false hasContentIssue false

An identity for Markovian replacement processes

Published online by Cambridge University Press:  14 July 2016

Petr Mandl*
Affiliation:
Australian National University

Summary

A Markovian process with rewards is considered. The interference into its development consists in instantaneous changes of state called replacements. It is shown that, for any replacement policy not depending on the future, the expected reward is a linear function of the expected replacement numbers. The application of this result is illustrated by examples.

Type
Research Papers
Copyright
Copyright © Sheffield: Applied Probability Trust 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Derman, C. (1963) Optimal replacement and maintenance under Markovian deterioration with probability bounds on failure. Management Sci. 9, 478481.Google Scholar
[2] Howard, R. A. (1960) Dynamic Programming and Markov Processes. MIT Press and John Wiley, New York and London.Google Scholar