Hostname: page-component-586b7cd67f-rcrh6 Total loading time: 0 Render date: 2024-11-26T07:43:42.015Z Has data issue: false hasContentIssue false
  • English
  • Français

Generalizations of Wald's fundamental identity of sequential analysis to Markov chains

Published online by Cambridge University Press:  24 October 2008

M. C. K. Tweedie
M. C. K. Tweedie
Affiliation:
The UniversityLiverpool
Get access Rights & Permissions [Opens in a new window]

Abstract

An extension of Bellman's analogue of Wald's identity is proved for Markov processes with a finite number of states, in which (a) the diagonal matrices of the state functions and the transition matrices may be heterogeneous but are so related that the product of the two matrices which apply at any stage has at least one modal vector in common with all of the corresponding products which apply at other stages, and (b) the probability distribution of the duration of any one realization of the process satisfies certain conditions. The condition (a) is called equimodality. The conditions for (b) are satisfied when there is asymptotically a sufficiently abrupt exponential upper bound to the probability distribution of the duration, and extends simply to validate analogues involving latent roots other than the one which appears in Bellman's formula. A certain generalization of Wald's stopping rule produces a bound of this kind.

Type
Research Article
Information
Mathematical Proceedings of the Cambridge Philosophical Society , Volume 56 , Issue 3 , July 1960 , pp. 205 - 214
Copyright
Copyright © Cambridge Philosophical Society 1960

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

(1)Bellman, R.On a generalization of the fundamental identity of Wald. Proc. Comb. Phil. Soc. 53 (1957), 257–9.CrossRefGoogle Scholar
(2)Wald, A.Sequential analysis. (London, 1947).Google Scholar
(3)Feller, W.An introduction to probability theory and its applications, vol. 1, second edition (London, 1957).Google Scholar
(4)Bartlett, M. S.An introduction to stochastic processes (Cambridge, 1956).Google Scholar
(5)Mirsky, L.An introduction to linear algebra (Oxford, 1955).Google Scholar
(6)Turnbull, H. W. and Aitken, A. C.An introduction to the theory of canonical matrices. (London, 1932).Google Scholar
(7)Ruben, H.A theorem on the cumulative product of independent random variables. Proc. Camb. Phil. Soc. 55 (1959), 333–7.CrossRefGoogle Scholar
(8)Fréchet, M. Recherches théoriques modernes sur le calcul des probabilités, livre 2. Traité du calcul des probabilités (ed. Borel, ), 1, fasc. 3 (Paris, 1938).Google Scholar
(9)Blom, G.A generalization of Wald's fundamental identity. Ann. Math. Statist. 20 (1949), 439–44.CrossRefGoogle Scholar