Hostname: page-component-586b7cd67f-dsjbd Total loading time: 0 Render date: 2024-11-26T05:02:49.743Z Has data issue: false hasContentIssue false
  • English
  • Français

ARMA processes have maximal entropy among time series with prescribed autocovariances and impulse responses

Published online by Cambridge University Press:  01 July 2016

Jürgen Franke
Jürgen Franke*
Affiliation:
University of Frankfurt
*
∗Postal address: Department of Mathematics, University of Frankfurt, P.O. Box 111 932, D-6000 Frankfurt, West Germany.
Get access Rights & Permissions [Opens in a new window]

Abstract

The maximum-entropy approach to the estimation of the spectral density of a time series has become quite popular during the last decade. It is closely related to the fact that an autoregressive process of order p has maximal entropy among all time series sharing the same autocovariances up to lag p. We give a natural generalization of this result by proving that a mixed autoregressive-moving-average process (ARMA process) of order (p, q) has maximal entropy among all time series sharing the same autocovariances up to lag p and the same impulse response coefficients up to lag q. The latter may be estimated from a finite record of the time series, for example by using a method proposed by Bhansali (1976). By the way, we give a result on the existence of ARMA processes with prescribed autocovariances up to lag p and impulse response coefficients up to lag q.

Keywords

MIXED AUTOREGRESSIVE-MOVING-AVERAGE PROCESSMAXIMUM ENTROPY METHOD
Type
Research Article
Information
Advances in Applied Probability , Volume 17 , Issue 4 , December 1985 , pp. 810 - 840
Copyright
Copyright © Applied Probability Trust 1985 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Box, G. E. P. and Jenkins, G. ?. (1976) Time Series Analysis: Forecasting and Control. Holden-Day, San Francisco.Google Scholar
Bhansali, R. J. (1976) Estimation of the moving average representation of a stationary nondeterministic process. Biometrika 63, 408–410.CrossRefGoogle Scholar
Burg, J. P. (1978a) Maximum entropy spectral analysis. In Modern Spectrum Analysis , ed. Childers, D. G., Wiley, New York.Google Scholar
Burg, J. P. (1978b) A new analysis technique for time series data. In Modern Spectrum Analysis , ed. Childers, D. G. Wiley, New York.Google Scholar
Childers, D. G. (1978) Modern Spectrum Analysis. IEEE Press Selected Reprint Series, Wiley, New York.Google Scholar
Edward, J. A. and Fitelson, ?. M. (1973) Notes on maximum entropy processing. IEEE Trans. Inf. Theory IT-19, 232–234.CrossRefGoogle Scholar
Franke, J. (1985a) Minimax-robust prediction of discrete time series. Z. Wahrscheinlichkeitsth.CrossRefGoogle Scholar
Franke, J. (1985b) A Levinson-Durbin recursion for ARMA-processes. Biometrika. Google Scholar
Franke, J. and Poor, V. H. (1984) Minimax-robust filtering and finite-length robust predictors. In Robust and Nonlinear Time Series Analysis , ed. Franke, J., Härdle, W. and Martin, R. D. Lecture Notes in Statistics. Springer-Verlag, Berlin.CrossRefGoogle Scholar
Grandell, J., Hamrud, M. and Toll, P. (1980) A remark on the correspondence between the maximum entropy method and the autoregressive model. IEEE Trans. Inf. Theory GG-26, 750–751.CrossRefGoogle Scholar
Greub, W. H. (1967) Linear Algebra. Springer-Verlag, Berlin.CrossRefGoogle Scholar
Hannan, E. J. (1970) Multiple Time Series. Wiley, New York.CrossRefGoogle Scholar
Hannan, E. J. (1975) The estimation of ARMA models. Ann. Statist. 3, 975–981.CrossRefGoogle Scholar
Hoffman, K. (1962) Banach Spaces of Analytic Functions. Prentice Hall, Englewood Cliffsm, NJ. Google Scholar
Ihara, S. (1984) Maximum entropy spectral analysis and ARMA processes. IEEE Trans. Inf. Theory IT-30, 377–380.CrossRefGoogle Scholar
Pagano, M. (1973) When is an autoregressive scheme stationary? Commun. Statist. 1, 533–544.CrossRefGoogle Scholar
Priestley, M. B. (1981) Spectral Analysis and Time Series. Academic Press, London.Google Scholar
Shannon, C. E. and Weaver, W. (1949) The Mathematical Theory of Communication. The University of Illinois Press, Urbana.Google Scholar
Urbanik, K. (1967) Lectures on Prediction Theory. Lecture Notes in Mathematics 44. Springer-Verlag, Berlin.CrossRefGoogle Scholar