Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-05T15:30:29.477Z Has data issue: false hasContentIssue false
  • English
  • Français

ASYMPTOTIC SIZE AND A PROBLEM WITH SUBSAMPLING AND WITH THE m OUT OF n BOOTSTRAP

Published online by Cambridge University Press:  02 October 2009

Donald W.K. Andrews  and
Patrik Guggenberger
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper considers inference based on a test statistic that has a limit distribution that is discontinuous in a parameter. The paper shows that subsampling and m out of n bootstrap tests based on such a test statistic often have asymptotic size—defined as the limit of exact size—that is greater than the nominal level of the tests. This is due to a lack of uniformity in the pointwise asymptotics. We determine precisely the asymptotic size of such tests under a general set of high-level conditions that are relatively easy to verify. The results show that the asymptotic size of subsampling and m out of n bootstrap tests is distorted in some examples but not in others.

Type
Research Article
Information
Econometric Theory , Volume 26 , Issue 2 , April 2010 , pp. 426 - 468
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This paper previously circulated under the title “The Limit of Finite-Sample Size and a Problem with Subsampling” as Cowles Foundation Discussion Paper No. 1605. Andrews was supported by NSF grants SES-0417911 and SES-0751517. Guggenberger was supported by a Sloan fellowship, a UCLA faculty research grant in 2005 and NSF grant SES-0748922. For helpful comments, we thank two referees, the co-editor Richard Smith, Victor Chernozhukov, In Choi, Russell Davidson, Hannes Leeb, David Pollard, Azeem Shaikh, Jim Stock, Michael Wolf, and the participants at various seminars and conferences at which the paper was presented.

References

REFERENCES

Anatolyev, S. (2004) Inference when a nuisance parameter is weakly identified under the null hypothesis. Economic Letters 84, 245–254.Google Scholar
Andrews, D.W.K. (1999) Estimation when a parameter is on a boundary. Econometrica 67, 1341–1383.10.1111/1468-0262.00082Google Scholar
Andrews, D.W.K. (2000) Inconsistency of the bootstrap when a parameter is on the boundary of the parameter space. Econometrica 68, 399–405.10.1111/1468-0262.00114Google Scholar
Andrews, D.W.K. (2001) Testing when a parameter is on the boundary of the maintained hypothesis. Econometrica 69, 683–734.Google Scholar
Andrews, D.W.K. & Guggenberger, P. (2010) Applications of subsampling, hybrid, and size-correction methods. Journal of Econometrics, forthcoming.10.1016/j.jeconom.2010.01.002Google Scholar
Andrews, D.W.K. & Guggenberger, P. (2009a) Hybrid and size-corrected subsampling methods. Econometrica 77, 721–762.Google Scholar
Andrews, D.W.K. & Guggenberger, P. (2009b) Validity of subsampling and “plug-in asymptotic” inference for parameters defined by moment inequalities. Econometric Theory 25, 669–709.10.1017/S0266466608090257Google Scholar
Andrews, D.W.K. & Guggenberger, P. (2009c) Incorrect asymptotic size of subsampling procedures based on post-consistent model selection estimators. Journal of Econometrics, forthcoming.Google Scholar
Andrews, D.W.K. & Stock, J.H. (2007) Inference with weak instruments. In Blundell, R., Newey, W.K., & Persson, T. (eds.), Advances in Economics and Econometrics, Theory and Applications: Ninth World Congress of the Econometric Society, vol. III. Cambridge University Press.Google Scholar
Athreya, K.B. (1987) Bootstrap of the mean in the infinite variance case. Annals of Statistics 15, 724–731.Google Scholar
Bahadur, R.R. & Savage, L.J. (1956) The nonexistence of certain statistical procedures in nonparametric problems. Annals of Mathematical Statistics 25, 1115–1122.CrossRefGoogle Scholar
Beran, R. (1984) Bootstrap methods in statistics. Jber. d. Dt. Math.Verein. 86, 14–30.Google Scholar
Beran, R. (1997) Diagnosing bootstrap success. Annals of the Institute of Statistical Mathematics 49, 1–24.Google Scholar
Beran, R. & Srivastava, M.S. (1987) Correction: Bootstrap tests and confidence regions for functions of a covariance matrix. Annals of Statistics 15, 470–471.Google Scholar
Bickel, P.J. & Freedman, D.A. (1981) Some asymptotic theory for the bootstrap. Annals of Statistics 9, 1196–1217.Google Scholar
Bickel, P.J., Götze, F., and van Zwet, W.R. (1997) Resampling fewer than n observations: Gains, losses, and remedies for losses. Statistica Sinica 7, 1–31.Google Scholar
Bretagnolle, J. (1983) Lois limites du bootstrap de certaines fonctionelles. Annals of the Institute of H. Poincaré: Probability and Statistics 19, 281–296.Google Scholar
Cavanagh, C.L., Elliot, G., & Stock, J.H. (1995). Inference in models with nearly integrated regressors. Econometric Theory 11, 1131–1147.10.1017/S0266466600009981Google Scholar
Dufour, J.-M (1997) Some impossibility theorems in econometrics with applications to structural and dynamic models. Econometrica 65, 1365–1387.Google Scholar
Dufour, J.-M. (2003) Identification, weak instruments, and statistical inference in econometrics. Canadian Journal of Economics 36, 767–808.Google Scholar
Dümbgen, L. (1993) On differentiable functions and the bootstrap. Probability Theory and Related Fields 95, 125–140.Google Scholar
Eaton, M.L. & Tyler, D.E. (1991) On Wieland’s inequality and its applications to the asymptotic distribution of the eigenvalues of a random symmetric matrix. Annals of Statistics 19, 260–271.Google Scholar
Giné, E. & Zinn, J. (1990) Bootstrapping general empirical measures. Annals of Statistics 18, 851–869.Google Scholar
Gleser, L.J. & Hwang, J.T. (1987) The nonexistence of 100(1−α)% confidence sets of finite expected diameter in errors-in-variables and related models. Annals of Statistics 15, 1351–1362.Google Scholar
Guggenberger, P. (2007) The impact of a Hausman pretest on the asymptotic size of a hypothesis test: The panel data case. Unpublished working paper, Department of Economics, UCLA.Google Scholar
Guggenberger, P. (2009) On the asymptotic size distortion of tests when instruments locally violate the exogeneity assumption. Working paper, Department of Economics, UCLA.Google Scholar
Guggenberger, P. (2010) The impact of a Hausman pretest on the asymptotic size of a hypothesis test. Econometric Theory 26, 362–376.Google Scholar
Guggenberger, P. & Wolf, M. (2004) Subsampling tests of parameter hypotheses and overidentifying restrictions with possible failure of identification. Unpublished working paper, UCLA.Google Scholar
Hahn, J. & Hausman, J. (2003) Weak instruments: Diagnosis and cures in empirical economics. American Economic Review 93, 118–125.Google Scholar
Hájek, J. (1971) Limiting properties of likelihoods and inference. In Godambe, V.P. & Sprott, D.A. (eds.), Foundations of Statistical Inference: Proceedings of the Symposium on the Foundations of Statistical Inference, Univ. Waterloo, Ontario, pp. 142–159. Holt, Rinehart, and Winston.Google Scholar
Hall, P. & Jing, B. (1995) Uniform coverage bounds for confidence intervals and Berry-Esseen theorems for Edgeworth expansion. Annals of Statistics 23, 363–375.Google Scholar
Imbens, G. & Manski, C.F. (2004) Confidence intervals for partially identified parameters. Econometrica 72, 1845–1857.Google Scholar
Kabaila, P. (1995) The effect of model selection on confidence regions and prediction regions. Econometric Theory 11, 537–549.CrossRefGoogle Scholar
Kleibergen, F. (2008) Size correct subset statistics for the linear IV regression model. Unpublished working paper, Brown University.Google Scholar
LeCam, L. (1953) On some asymptotic properties of maximum likelihood estimates and related Bayes’ estimates. University of California Publications in Statistics 1, 277–330.Google Scholar
Leeb, H. & Pötscher, B.M. (2005) Model selection and inference: Facts and fiction. Econometric Theory 21, 21–59.10.1017/S0266466605050036Google Scholar
Leeb, H. & Pötscher, B.M. (2006) Performance limits for estimators of the risk or distribution of shrinkage-type estimators, and some general lower risk-bound results. Econometric Theory 22, 69–97.CrossRefGoogle Scholar
Lehmann, E.L. & Romano, J.P. (2005) Testing Statistical Hypotheses, 3rd ed. Wiley.Google Scholar
Loh, W.-Y. (1985) A new method for testing separate families of hypotheses. Journal of the American Statistical Association 80, 362–368.Google Scholar
Mikusheva, A. (2007) Uniform inferences in autoregressive models. Econometrica 75, 1411–1452.Google Scholar
Pfanzagl, J. (1973) The accuracy of the normal approximation for estimates of vector parameters. Z. Wahr. verw. Geb. 25, 171–198.Google Scholar
Politis, D.N. & Romano, J.P. (1994) Large sample confidence regions based on subsamples under minimal assumptions. Annals of Statistics 22, 2031–2050.Google Scholar
Politis, D.N., Romano, J.P., & Wolf, M. (1999) Subsampling. Springer.Google Scholar
Pötscher, B.M. (2002) Lower risk bounds and properties of confidence sets for ill-posed estimation problems with applications to spectral density and persistence estimation, unit roots, and estimation of long memory parameters. Econometrica 70, 1035–1065.Google Scholar
Rao, C.R. (1963) Criteria of estimation in large samples. Sankhya 25, 189–206.Google Scholar
Rao, C.R. (1973) Linear Statistical Inference and Its Applications, 2nd ed. Wiley.Google Scholar
Romano, J.P. (1989) Do bootstrap confidence procedures behave well uniformly in P? Canadian Journal of Statistics 17, 75–80.Google Scholar
Romano, J.P. & Shaikh, A.M. (2005) Inference for the identified set in partially identified econometric models. Unpublished working paper, University of Chicago.Google Scholar
Romano, J.P. & Shaikh, A.M. (2008) Inference for identifiable parameters in partially identified econometric models. Journal of Statistical Inference and Planning (Special Issue in Honor of T.W. Anderson) 138, 2786–2807.Google Scholar
Romano, J.P. & Wolf, M. (2001) Subsampling intervals in autoregressive models with linear time trend. Econometrica 69, 1283–1314.Google Scholar
Samworth, R. (2003) A note on methods of restoring consistency to the bootstrap. Biometrika 90, 985–990.Google Scholar
Sen, P.K. (1979) Asymptotic properties of maximum likelihood estimators based on conditional specification. Annals of Statistics 7, 1019–1033.Google Scholar
Sen, P.K. & Saleh, A.K.M.E. (1987) On preliminary test and shrinkage M-estimation in linear models. Annals of Statistics 15, 1580–1592.Google Scholar
Shao, J. (1994) Bootstrap sample size in nonregular cases. Proceedings of the American Mathematical Society 112, 1251–1262.Google Scholar
Shao, J. (1996) Bootstrap model selection. Journal of the American Statistical Association 91, 655–665.10.1080/01621459.1996.10476934Google Scholar
Shao, J. & Wu, C.J.F. (1989) A general theory for jackknife variance estimation. Annals of Statistics 15, 1563–1579.Google Scholar
Sheehy, A. & Wellner, J.A. (1992) Uniform Donsker classes of functions. Annals of Statistics 20, 1983–2030.Google Scholar
Staiger, D. & Stock, J.H. (1997) Instrumental variables regression with weak instruments. Econometrica 65, 557–586.Google Scholar
Stock, J.H. (1991) Confidence intervals for the largest autoregressive root in U.S. macroeconomic time series. Journal of Monetary Economics 28, 435–459.Google Scholar
Stock, J.H., Wright, J.H., & Yogo, M. (2002) A survey of weak instruments and weak identification in generalized method of moments. Journal of Business and Economic Statistics 20, 518–529.Google Scholar
Swanepoel, J.W.H. (1986) A note on proving that the (modified) bootstrap works. Communications in Statistics: Theory Methods 15, 3193–3203.Google Scholar
Wu, C.F.J. (1990) On the asymptotic properties of the jackknife histogram. Annals of Statistics 18, 1438–1452.Google Scholar