Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-29T00:16:53.378Z Has data issue: false hasContentIssue false
  • English
  • Français

Statistical Model Selection Criteria and Bayesianism

Published online by Cambridge University Press:  01 April 2022

I. A. Kieseppä
I. A. Kieseppä*
Affiliation:
University of Helsinki
*
†Send requests for reprints to the author, Department of Philosophy, P.O. Box 24 (Unioninkatu 40), 00014 University of Helsinki, Finland; email: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

Two Bayesian approaches to choosing between statistical models are contrasted. One of these is an approach which Bayesian statisticians regularly use for motivating the use of AIC, BIC, and other similar model selection criteria, and the other one is a new approach which has recently been proposed by Bandyopadhayay, Boik, and Basu. The latter approach is criticized, and the basic ideas of the former approach are presented in a way that makes them accessible to a philosophical audience. It is also pointed out that the former approach establishes a new, philosophically interesting connection between the notions of simplicity and informativeness.

Type
Bayesian Methodology
Information
Philosophy of Science , Volume 68 , Issue S3: No. 3 Supplement: Proceedings of the 2000 Biennial Meeting of the Philosophy of Science Association. Part I: Contributed Papers Sep., 2001 , 2001 , pp. S141 - S152
Copyright
Copyright © Philosophy of Science Association 2001

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

‡

I would like to express my gratitude to Jouni Kuha for his critical comments on an earlier version of this paper.

References

Bandyopadhayay, S. Prasanta, Boik, Robert J., and Basu, Prasun (1996), “The Curve-Fitting Problem: A Bayesian Approach”, Philosophy of Science 63 (Proceedings): S264–S272.10.1086/289960CrossRefGoogle Scholar
Burnham, Kenneth P. and Anderson, David R. (1998), Model Selection and Inference. A Practical Information-Theoretic Approach. New York: Springer.10.1007/978-1-4757-2917-7CrossRefGoogle Scholar
Forster, Malcolm (forthcoming), “The New Science of Simplicity”, in Keuzenkamp, Hugo, McAleer, Michael, and Zellner, Arnold (eds.), Simplicity, Inference and Econometric Modelling. Cambridge: Cambridge University Press.Google Scholar
Forster, Malcolm and Sober, Elliot (1994), “How to Tell when Simpler, More Unified, or Less Ad Hoc Theories will Provide More Accurate Predictions”, British Journal for the Philosophy of Science 45:1–35.10.1093/bjps/45.1.1CrossRefGoogle Scholar
Kieseppä, I. A. (1997), “Akaike Information Criterion, Curve-fitting, and the Philosophical Problem of Simplicity”, British Journal for the Philosophy of Science 48:21–48.10.1093/bjps/48.1.21CrossRefGoogle Scholar
Kuha, Jouni (n.d.), “Simplicity and Model Fit: Implications of a Bayesian Approach”, manuscript.Google Scholar
Raftery, Adrian E. (1995), “Bayesian Model Selection in Social Research”, in Marsden, Peter V. (ed.), Sociological Methodology 1995. Washington, DC: Blackwell Publishers, 111–163.Google Scholar
Sakamoto, Yosiyuki, Ishiguro, M., and Kitagawa, G. (1986), Akaike Information Criterion Statistics. Tokyo: KTK Scientific Publishers.Google Scholar
Schwarz, Gideon (1978), “Estimating the Dimension of a Model”, Annals of Statistics 6:461–464.10.1214/aos/1176344136CrossRefGoogle Scholar
Smith, A. F. M. and Spiegelhalter, D. J. (1980), “Bayes Factors and Choice Criteria for Linear Models”, Journal of the Royal Statistical Society, Series B 42:213–220.Google Scholar
Wetherill, G. Barrie et al. (1986), Regression Analysis with Applications. London: Chapman and Hall Ltd.CrossRefGoogle Scholar