Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-28T13:15:47.387Z Has data issue: false hasContentIssue false

TRANSFORMATIONS FOR MULTIVARIATE STATISTICS

Published online by Cambridge University Press:  01 October 2004

Patrick Marsh
Affiliation:
University of York

Abstract

This paper derives transformations for multivariate statistics that eliminate asymptotic skewness, extending the results of Niki and Konishi (1986, Annals of the Institute of Statistical Mathematics 38, 371–383). Within the context of valid Edgeworth expansions for such statistics we first derive the set of equations that such a transformation must satisfy and second propose a local solution that is sufficient up to the desired order. Application of these results yields two useful corollaries. First, it is possible to eliminate the first correction term in an Edgeworth expansion, thereby accelerating convergence to the leading term normal approximation. Second, bootstrapping the transformed statistic can yield the same rate of convergence of the double, or prepivoted, bootstrap of Beran (1988, Journal of the American Statistical Association 83, 687–697), applied to the original statistic, implying a significant computational saving.

The analytic results are illustrated by application to the family of exponential models, in which the transformation is seen to depend only upon the properties of the likelihood. The numerical properties are examined within a class of nonlinear regression models (logit, probit, Poisson, and exponential regressions), where the adequacy of the limiting normal and of the bootstrap (utilizing the k-step procedure of Andrews, 2002, Econometrica 70, 119–162) as distributional approximations is assessed.This paper is derived from my Ph.D. thesis, “Higher-Order Asymptotics for Econometric Estimators and Tests,” for which thanks for patient and helpful supervision go to Grant Hillier. Comments by Karim Abadir, Francesco Bravo, Giovanni Forchini, Soren Johansen, Paul Marriott, Mark Salmon, and Steve Satchell, participants at the conference “Differential Geometric Methods in Econometrics,” held at EUI, Florence, and by two anonymous referees proved most helpful. In particular, I thank Peter Phillips for showing interest in the paper, helping with improving the exposition, and providing me with copies of two unpublished research notes. Financial support in the form of a Leverhulme Special Research Fellowship in Economics and Mathematics is gratefully acknowledged.

Type
Research Article
Copyright
© 2004 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Andrews, D.W.K. (2002) Higher-order improvements of a computationally attractive k-step bootstrap for extremum estimators. Econometrica 70, 119162.Google Scholar
Armstrong, M. & G.H. Hillier (1999) The density of the maximum likelihood estimator. Econometrica 67, 14591470.Google Scholar
Barndorff-Nielsen, O.E. & D. Cox (1989) Asymptotic Techniques for Use in Statistics. Chapman and Hall.
Beran, R. (1988) Prepivoting test statistics: A bootstrap view of asymptotic refinements. Journal of the American Statistical Association 83, 687697.Google Scholar
Bhattacharya, R.N. & J.K. Ghosh (1978) On the validity of the formal Edgeworth expansion. Annals of Statistics 6, 434451.Google Scholar
Chesher, A. & R. Spady (1991) Asymptotic expansion of the information matrix test statistic. Econometrica 59, 787815.Google Scholar
Daniels, H.E. (1954) Saddlepoint approximations in statistics. Annals of Mathematical Statistics 25, 631650.Google Scholar
Davidson, R. & J.G. MacKinnon (1999) Bootstrap testing in nonlinear models. International Economic Review 40, 487508.Google Scholar
Durbin, J. (1980) Approximations for the densities of sufficient estimates. Biometrika 77, 311333.Google Scholar
Elliott, G., T.J. Rothenberg, & J.H. Stock (1996) Efficient tests for an autoregressive unit root. Econometrica 64, 813836.Google Scholar
Hall, P. (1992) The Bootstrap and Edgeworth Expansion. Springer Series in Statistics. Springer-Verlag.
Horowitz, J.L. (1994) Bootstrap-based critical values for the information matrix test. Journal of Econometrics 61, 395411.Google Scholar
Horowitz, J.L. (2001) The bootstrap. In J.J. Heckman & E. Leamer (eds.), Handbook of Econometrics, vol. 5, chap. 52, pp. 31593228. Elsevier Science.
Horowitz, J.L. & N.E. Savin (2000) Empirically relevant critical values for hypothesis tests: A bootstrap approach. Journal of Econometrics 95, 375389.Google Scholar
Hougaard, P. (1982) Parameterizations of nonlinear models. Journal of the Royal Statistical Society, Series B 44, 244252.Google Scholar
Linton, O. (1997) An asymptotic expansion in the GARCH(1,1) model. Econometric Theory 13, 558581.Google Scholar
Marsh, P.W.N. (2001) Edgeworth expansions in Gaussian autoregression. Statistics and Probability Letters 54, 233241.Google Scholar
McCullagh, P. (1984) Local sufficiency. Biometrika 71, 233244.Google Scholar
McCullagh, P. (1987) Tensor Methods in Statistics. Chapman and Hall.
Niki, N. & S. Konishi (1986) Effects of transformations in higher order asymptotic expansions. Annals of the Institute of Statistical Mathematics 38, 371383.Google Scholar
Phillips, P.C.B. (1977a) Approximations to some finite sample distributions associated with a first-order stochastic difference equation. Econometrica 45, 463485.Google Scholar
Phillips, P.C.B. (1977b) A general theorem in the theory of asymptotic expansions as approximations to the finite sample distribution of econometric estimators. Econometrica 45, 15171534.Google Scholar
Phillips, P.C.B. (1979a) Expansions for Transformations of Statistics. Research note, University of Birmingham, U.K.
Phillips, P.C.B. (1979b) Normalising transformation for [alpha with caret accent]. Research note, University of Birmingham, U.K.
Phillips, P.C.B. & J. Park (1988) On the formulation of Wald tests of nonlinear restrictions. Econometrica 45, 463485.Google Scholar
Sargan, J.D. (1976) Econometric estimators and the Edgeworth expansion. Econometrica 44, 421448.Google Scholar
Sargan, J.D. & S. Satchell (1986) A theorem of validity for Edgeworth expansions. Econometrica 54, 189213.Google Scholar
Satchell, S. (1984) Approximation to the finite sample distribution for non-stable first-order stochastic difference equation. Econometrica, 52, 12711289.Google Scholar
Skovgaard, I.M. (1981) Transformation of an Edgeworth expansion by a sequence of smooth functions. Scandinavian Journal of Statistics 8, 207217.Google Scholar
Taniguchi, M. (1991) Higher Order Asymptotic Theory for Time Series Analysis. Lecture Notes in Statistics. Springer-Berlin.
van Garderen, K.-J. (1997) Curved exponential models in statistics. Econometric Theory 15, 771790.Google Scholar
van Garderen, K.-J. (1998) An alternative comparison of classical tests: Assessing the effects of curvature. In M. Salmon & P. Marriott (eds.), Applications of Differential Geometry to Econometrics, pp. 230280. Cambridge University Press.