Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-27T18:20:04.508Z Has data issue: false hasContentIssue false
  • English
  • Français

LARGE SAMPLE JUSTIFICATIONS FOR THE BAYESIAN EMPIRICAL LIKELIHOOD

Published online by Cambridge University Press:  05 December 2022

Naoya Sueishi Open the ORCID record for Naoya Sueishi [Opens in a new window]
Naoya Sueishi*
Affiliation:
Kobe University
*
Address correspondence to Naoya Sueishi, Graduate School of Economics, Kobe University, 2-1 Rokkodai-cho, Nada-ku, Kobe, Hyogo 657-8501, Japan; e-mail: [email protected].
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

This study investigates the asymptotic properties of the Bayesian empirical likelihood (BEL), which uses the empirical likelihood as an alternative to a parametric likelihood for Bayesian inference. We establish two asymptotic equivalence results based on the Bernstein–von Mises (BvM) theorem by introducing a new formulation of the moment restriction model. First, the limiting posterior distribution of the BEL is the same as that of a parametric Bayesian method that uses the likelihood of a least favorable model of the moment restriction model. Second, the limiting posterior distribution is also the same as that of a semiparametric Bayesian method that places priors on both a finite-dimensional parameter of interest and an infinite-dimensional nuisance parameter. Because parametric and semiparametric Bayesian methods are legitimate Bayesian procedures, the equivalence results provide a large sample justification for the BEL as a Bayesian inference method. Moreover, the BvM theorem provides a frequentist justification for BEL posterior inference.

Type
MISCELLANEA
Information
Econometric Theory , Volume 40 , Issue 4 , August 2024 , pp. 926 - 956
Copyright
© The Author(s), 2022. Published by Cambridge University Press

Footnotes

I would like to thank Patrik Guggenberger and two anonymous referees for their comments and suggestions. I would also like to thank Mototsugu Shintani, Kohtaro Hitomi, Yoshihiko Nishiyama, and Takahide Yanagi for their comments. This research was supported by JSPS KAKENHI Grant Number 18K01547.

References

REFERENCES

Andrews, I. & Mikusheva, A. (2022) Optimal decision rules for weak GMM. Econometrica 90, 715–748.CrossRefGoogle Scholar
Bedoui, A. & Lazar, N.A. (2020) Bayesian empirical likelihood for ridge and lasso regressions. Computational Statistics and Data Analysis 145, 106917.CrossRefGoogle Scholar
Begun, J.M., Hall, W.J., Huang, W.-M., & Wellner, J.A. (1983) Information and asymptotic efficiency in parametric-nonparametric models. Annals of Statistics 11, 432–452.CrossRefGoogle Scholar
Bertail, P. (2006) Empirical likelihood in some semiparametric models. Bernoulli 12, 299–331.CrossRefGoogle Scholar
Bickel, P.J. & Kleijn, J.K. (2012) The semiparametric Bernstein–von Mises theorem. Annals of Statistics 40, 206–237.CrossRefGoogle Scholar
Bornn, L., Shephard, N., & Solgi, R. (2019) Moment conditions and Bayesian non-parametrics. Journal of the Royal Statistical Society, Series B 81, 5–43.CrossRefGoogle Scholar
Borwein, J.M. & Lewis, A.S. (1991) Duality relationships for entropy-like minimization problems. SIAM Journal on Control and Optimization 29, 325–338.CrossRefGoogle Scholar
Chae, M. (2015) The semiparametric Bernstein–von Mises theorem for models with symmetric error. PhD thesis, Seoul National University.Google Scholar
Chamberlain, G. (1987) Asymptotic efficiency in estimation with conditional moment restrictions. Journal of Econometrics 34, 305–334.CrossRefGoogle Scholar
Chamberlain, G. & Imbens, G.W. (2003) Nonparametric applications of Bayesian inference. Journal of Business & Economic Statistics 21, 12–18.CrossRefGoogle Scholar
Chaudhuri, S., Mondal, D., & Yin, T. (2017) Hamiltonian Monte Carlo sampling in Bayesian empirical likelihood computation. Journal of the Royal Statistical Society, Series B 79, 293–320.CrossRefGoogle Scholar
Chen, X., Hong, H., & Shum, M. (2007) Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models. Journal of Econometrics 141, 109–140.CrossRefGoogle Scholar
Cheng, Y. & Zhao, Y. (2019) Bayesian jackknife empirical likelihood. Biometrika 106, 981–988.CrossRefGoogle Scholar
Chernozhukov, V. & Hong, H. (2003) An MCMC approach to classical estimation. Journal of Econometrics 115, 293–346.CrossRefGoogle Scholar
Chib, S., Shin, M., & Simoni, A. (2018) Bayesian estimation and comparison of moment condition models. Journal of the American Statistical Association 113, 1656–1668.CrossRefGoogle Scholar
Csiszár, I. (1995) Generalized projections for non-negative functions. Acta Mathematica Hungarica 68, 161–185.CrossRefGoogle Scholar
DiCiccio, T.J. & Romano, J.P. (1990) Nonparametric confidence limits by resampling methods and least favorable families. International Statistical Review 58, 59–76.CrossRefGoogle Scholar
Dovonon, P. & Atchadé, Y.F. (2020) Efficiency bounds for semiparametric models with singular score functions. Econometric Reviews 39, 612–648.CrossRefGoogle Scholar
Fang, K.-T. & Mukerjee, R. (2006) Empirical-type likelihoods allowing posterior credible sets with frequentist validity: Higher-order asymptotics. Biometrika 93, 723–733.CrossRefGoogle Scholar
Fernández-Villaverde, J. (2010) The econometrics of DSGE models. SERIEs 1, 3–49.CrossRefGoogle Scholar
Florens, J. & Simoni, A. (2021) Gaussian processes and Bayesian moment estimation. Journal of Business & Economic Statistics 39, 482–492.CrossRefGoogle Scholar
Ghosal, S. & van der Vaart, A. (2017) Fundamentals of Nonparametric Bayesian Inference . Cambridge University Press.CrossRefGoogle Scholar
Hansen, L.P. (1982) Large sample properties of generalized method of moments estimators. Econometrica 50, 1029–1054.CrossRefGoogle Scholar
Imbens, G.W., Spady, R.H., & Johnson, P. (1998) Information theoretic approaches to inference in moment condition models. Econometrica 66, 333–357.CrossRefGoogle Scholar
Kim, J.-Y. (2002) Limited information likelihood and Bayesian analysis. Journal of Econometrics 107, 175–193.CrossRefGoogle Scholar
Kitamura, Y. (2007) Empirical likelihood methods in econometrics: Theory and practice. In Blundell, R., Newey, W. K., & Persson, T. (eds.), Advances in Economics and Econometrics , pp. 174–237. Cambridge University Press.Google Scholar
Kitamura, Y. & Otsu, T. (2011) Bayesian analysis of moment condition models using nonparametric priors. Unpublished Manuscript, Yale University.Google Scholar
Kitamura, Y. & Stutzer, M. (1997) An information-theoretic alternative to generalized method of moments estimation. Econometrica 65, 861–874.CrossRefGoogle Scholar
Kleijn, B.J.K. & van der Vaart, A.W. (2006) Misspecification in infinite-dimensional Bayesian statistics. Annals of Statistics 34, 837–877.CrossRefGoogle Scholar
Kleijn, B.J.K. & van der Vaart, A.W. (2012) The Bernstein–von-Mises theorem under misspecification. Electronic Journal of Statistics 6, 354–381.CrossRefGoogle Scholar
Komunjer, I. & Ragusa, G. (2016) Existence and characterization of conditional density projections. Econometric Theory 32, 947–987.CrossRefGoogle Scholar
Lazar, N.A. (2003) Bayesian empirical likelihood. Biometrika 90, 319–326.CrossRefGoogle Scholar
Lehmann, E.L. & Casella, G. (1998) Theory of Point Estimation . Springer.Google Scholar
Monahan, J.F. & Boos, D.D. (1992) Proper likelihood for Bayesian analysis. Biometrika 79, 271–278.CrossRefGoogle Scholar
Newey, W.K. (1994) The asymptotic variance of semiparametric estimators. Econometrica 62, 1349–1382.CrossRefGoogle Scholar
Newey, W.K. & Smith, R.J. (2004) Higher order properties of GMM and generalized empirical likelihood estimator. Econometrica 72, 219–255.CrossRefGoogle Scholar
Owen, A.B. (1990) Empirical likelihood ratio confidence regions. Annals of Statistics 18, 90–120.CrossRefGoogle Scholar
Owen, A.B. (2001) Empirical Likelihood . Chapman & Hall/CRC.Google Scholar
Pollard, D. (2010) Hellinger differentiability. http://www.stat.yale.edu/~pollard/Courses/618.fall2010/Handouts/prelim_version_DQM.pdf.Google Scholar
Qin, J. & Lawless, J. (1994) Empirical likelihood and generalized estimating equations. Annals of Statistics 22, 300–325.CrossRefGoogle Scholar
Ragusa, G. (2007) Bayesian Likelihoods for Moment Condition Models . University of California.Google Scholar
Rubin, D.B. (1981) The Bayesian bootstrap. Annals of Statistics 9, 130–134.CrossRefGoogle Scholar
Schennach, S.M. (2005) Bayesian exponentially tilted empirical likelihood. Biometrika 92, 31–46.CrossRefGoogle Scholar
Schennach, S.M. (2007) Point estimation with exponentially tilted empirical likelihood. Annals of Statistics 35, 634–672.CrossRefGoogle Scholar
Severini, T.A. (1999) On the relationship between Bayesian and non-Bayesian elimination of nuisance parameters. Statistica Sinica 9, 713–724.Google Scholar
Severini, T.A. & Tripathi, G. (2001) A simplified approach to computing efficiency bounds in semiparametric models. Journal of Econometrics 2001, 23–66.CrossRefGoogle Scholar
Shin, M. (2015) Bayesian GMM. PhD thesis, University of Pennsylvania.Google Scholar
Smith, R.J. (1997) Alternative semi-parametric likelihood approaches to generalised method of moments estimation. Economic Journal 107, 503–519.CrossRefGoogle Scholar
Sueishi, N. (2013) Identification problem of the exponential tilting estimator under misspecification. Economics Letters 118, 509–511.CrossRefGoogle Scholar
Sueishi, N. (2016) A simple derivation of the efficiency bound for conditional moment restriction models. Economics Letters 138, 57–59.CrossRefGoogle Scholar
van der Vaart, A.W. (1998) Asymptotic Statistics . Cambridge University Press.CrossRefGoogle Scholar
van der Vaart, A.W. & Wellner, J.A. (1996) Weak Convergence and Empirical Processes . Springer.CrossRefGoogle Scholar
Vexler, A., Tao, G., & Hutson, A.D. (2014) Posterior expectation based on empirical likelihoods. Biometrika 101, 711–718.CrossRefGoogle Scholar
Wu, Y. & Ghosal, S. (2008) Kullback Leibler property of kernel mixture priors in Bayesian density estimation. Electronic Journal of Statistics 2, 298–331.CrossRefGoogle Scholar
Yang, Y. & He, X. (2012) Bayesian empirical likelihood for quantile regression. Annals of Statistics 40, 1102–1131.CrossRefGoogle Scholar
Supplementary material: PDF

Sueishi supplementary material

Sueishi supplementary material

Download Sueishi supplementary material(PDF)
PDF 94.3 KB