Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-09T06:28:51.981Z Has data issue: false hasContentIssue false
  • English
  • Français

Randomization of intensities in a Markov chain

Published online by Cambridge University Press:  01 July 2016

M. Yadin  and
R. Syski
M. Yadin*
Affiliation:
Technion-Israel Institute of Technology
R. Syski*
Affiliation:
University of Maryland
*
∗Postal address: Faculty of Industrial and Management Engineering, Technion—Israel Institute of Technology, Haifa, Israel.
∗∗Permanent address: Department of Mathematics, University of Maryland, College Park. Maryland 20742, U.S.A. When this paper was written this author was Pinhas Naor Visiting Professor at the Faculty of Industrial and Management Engineering, Technion—Israel Institute of Technology, on leave from the University of Maryland.
Get access Rights & Permissions [Opens in a new window]

Abstract

The matrix of intensities of a Markov process with discrete state space and continuous time parameter undergoes random changes in time in such a way that it stays constant between random instants. The resulting non-Markovian process is analyzed with the help of supplementary process defined in terms of variations of the intensity matrix. Several examples are presented.

Keywords

BACKWARD EQUATIONINTENSITIESMARKOV CHAINSNON-HOMOGENEOUS CHAINSRANDOMIZATIONTWO-DIMENSIONAL CHAIN
Type
Research Article
Information
Advances in Applied Probability , Volume 11 , Issue 2 , June 1979 , pp. 397 - 421
Copyright
Copyright © Applied Probability Trust 1979 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Basawa, I. V. (1974) Maximum likelihood estimation of parameters in renewal and Markov-renewal processes. Austral. J. Statist. 16, 33–43.CrossRefGoogle Scholar
2. Feller, W. (1966) An Introduction to Probability Theory and its Applications, Vol. 2. Wiley, New York.Google Scholar
3. Kingman, J. F. C. (1963) Poisson counts for random sequences of events. Ann. Math. Statist. 34, 1217–1231.CrossRefGoogle Scholar
4. Pinsky, M. A. (1974) Multiplicative operator functionals. In Advances in Probability and Related Topics 3, ed. Ney, P. and Port, S. Dekker, New York, 1–100.Google Scholar
5. Yadin, M. (1978) On Markov processes with randomly varying intensities, with application to a queueing model. To appear.Google Scholar