Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-11-09T06:07:10.279Z Has data issue: false hasContentIssue false

ADAPTIVE ESTIMATORS OF A MEAN MATRIX: TOTAL LEAST SQUARES VERSUS TOTAL SHRINKAGE

Published online by Cambridge University Press:  15 January 2008

Rudolf Beran
Affiliation:
University of California, Davis

Abstract

An unknown constant matrix M is observed with additive random error. The basic problem considered is to devise an estimator of M that trades off bias against variance so as to achieve relatively low quadratic risk. This paper develops an adaptive total least squares estimator and an adaptive total shrinkage estimator of M that minimize estimated risk over certain large classes of linear estimators. It is shown that the asymptotic risk of the adaptive total least squares estimator is the smallest attainable among reduced rank total least squares fits to the data matrix. The asymptotic risk of the adaptive total shrinkage estimator is shown to be smaller still. A close link is established between total shrinkage and the Efron–Morris estimator of M. In the asymptotics, the row dimension of M tends to infinity, and the column dimension stays fixed. The risks converge uniformly when the signal-to-noise ratio and the measurement error variance are both bounded. A second problem treated is estimation of M under the assumption that a linear relation holds among its columns. In this formulation of the errors-in-variables linear regression model, rank constrained adaptive total least squares asymptotically dominates the usual total least squares estimator of M, and rank constrained adaptive total shrinkage is better still.This research was supported in part by National Science Foundation Grant DMS 0404547.

Type
Research Article
Copyright
© 2008 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Anderson, T.W. (1976) Estimation of linear functional relationships: Approximate distributions and connection with simultaneous equations in econometrics (with discussion). Journal of the Royal Statistical Society, Series B 38, 136.Google Scholar
Efron, B. & C. Morris (1976) Multivariate empirical Bayes and estimation of covariance matrices. Annals of Statistics 4, 2232.Google Scholar
Fuller, W.A. (1987) Error Measurement Models. Wiley.
Gleser, L.J. (1981) Estimation in a multivariate “errors in variables” regression model: Large sample results. Annals of Statistics 9, 2444.Google Scholar
Golub, G.H. & C.F. Van Loan (1980) An analysis of the total least squares problem. SIAM Journal on Numerical Analysis 17, 883893.Google Scholar
Golub, G.H. & C.F. Van Loan (1996) Matrix Computations, 3rd ed. Johns Hopkins University Press.
Green, A.A., M. Berman, P. Switzer, & M.D. Craig (1985) A transformation for ordering multispectral data in terms of image quality with implications for noise removal. IEEE Transactions on Geoscience and Remote Sensing 26, 6574.Google Scholar
James, W. & C. Stein (1961) Estimation with quadratic loss. In J. Neyman (ed.), Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 361380. University of California Press.
Neveu, J. (1965) Mathematical Foundations of the Calculus of Probability. Holden-Day.
Rao, C.R. & H. Toutenberg (1995) Linear Models. Least Squares and Alternatives. Springer.
Van Huffel, S. (2004) Total least squares and errors-in-variables modeling: Bridging the gap between statistics, computational mathematics and engineering. In J. Antoch (ed.), Compstat 2004: Proceedings in Computational Statistics, pp. 539555. Physica-Verlag.
Van Huffel, S. & J. Vandewalle (1991) The Total Least Squares Problem: Computational Aspects and Analysis. SIAM Publications.
Wichura, M.J. (1971) A note on the weak convergence of stochastic processes. Annals of Mathematical Statistics 42, 17691772.Google Scholar