Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-24T19:50:56.406Z Has data issue: false hasContentIssue false
  • English
  • Français

Shepp statistic for Markov chains application to a long-run average cost criterion

Published online by Cambridge University Press:  14 July 2016

Brahim Ksir
Brahim Ksir*
Affiliation:
University of Constantine
*
∗ Postal address: Institut de Mathématiques, Université de Constantine, 25000 Constantine, Algeria.
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper is a generalization to Markov chains of the work of Shepp [6] in the i.i.d case. Shepp studies the limiting values of the averages Tn = (Sn+ f(n) – Sn)/f(n) where Sn = X0 + X1+ · ·· + Xn, X0 = 0, n = 1, 2, ···, is a sum of mutually independent and identically distributed random variables. The function f takes positive integer values and non-decreasingly tends to infinity. Here we take a class of functions f in central position f(n) = [c log n], c > 0, n = 1, 2, ···. There are many refinements of the function f in the i.i.d case [1], [2]. Here we consider the more general case where X1, · ··, Xn is an irreducible and recurrent Markov chain. The state space of the chain is either compact or countable.

Keywords

RECURRENT MARKOV CHAINLONG-RUN AVERAGE COST CRITERION
Type
Research Papers
Information
Journal of Applied Probability , Volume 26 , Issue 4 , December 1989 , pp. 767 - 775
Copyright
Copyright © Applied Probability Trust 1989 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Research partly carried out while the author was on leave at LSTA, Université de Paris VI.

References

[1] Csörgo, M. and Steinebach, J. (1981) Improved Erdös-Rényi and strong approximation laws for increments of partial sums. Ann. Prob. 9, 988–998.CrossRefGoogle Scholar
[2] Deheuvels, P., Devroye, L. and Lynch, J. (1986) Exact convergence rate in the limit theorems of Erdös-Rényi and Shepp. Ann. Prob. 14, 209–223.CrossRefGoogle Scholar
[3] Donsker, M. D. and Varadhan, S. R. S. (1975) Asymptotic evaluation of certain Markov process expectations for large time I. Comm. Pure Appl. Maths. 28, 1–47.CrossRefGoogle Scholar
[4] Landers, D. and Rogge, L. (1976) On the rate of convergence in the central limit theorem for Markov chains. Z. Wahrscheinlichkeitsth. 35, 57–63.CrossRefGoogle Scholar
[5] Orey, S. (1971) Limit Theorems for Markov Chain Transition Probabilities. Van Nostrand, New York.Google Scholar
[6] Shepp, L. A. (1964) A limit theorem concerning moving averages. Ann. Math. Statist. 35, 424–428.CrossRefGoogle Scholar
[7] Tweedie, R. L. (1976) Criteria for classifying general Markov chains. Adv. Appl. Prob. 1, 737–771.CrossRefGoogle Scholar
[8] Tweedie, R. L. (1983) The existence of moments for stationary Markov chains. J. Appl. Prob. 20, 191–196.CrossRefGoogle Scholar