Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-669899f699-7tmb6 Total loading time: 0 Render date: 2025-04-28T18:28:38.882Z Has data issue: false hasContentIssue false

6 - Theory Testing in Economics and the Error-Statistical Perspective

Published online by Cambridge University Press:  29 January 2010

By
Aris Spanos
Edited by
Deborah G. Mayo  and
Aris Spanos
Deborah G. Mayo
Affiliation:
Virginia Polytechnic Institute and State University
Aris Spanos
Affiliation:
Virginia Polytechnic Institute and State University
Get access

Summary

Introduction

For a domain of inquiry to live up to standards of scientific objectivity it is generally required that its theories be tested against empirical data. The central philosophical and methodological problems of economics may be traced to the unique character of both economic theory and its nonexperimental (observational) data. Alternative ways of dealing with these problems are reflected in rival methodologies of economics. My goal here is not to promote any one such methodology at the expense of its rivals so much as to set the stage for understanding and making progress on certain crucial conundrums in the methodology and philosophy of economics. This goal, I maintain, requires an understanding of the changing roles of theory and data in the development of economic thought alongside the shifting philosophies of science, which explicitly or implicitly find their way into economic theorizing and econometric practice. Given that this requires both economists and philosophers of science to stand outside their usual practice and reflect on their own assumptions, it is not surprising that this goal has been rather elusive.

The Preeminence of Theory in Economic Modeling

Historically, theory has generally held the preeminent role in economics, and data have been given the subordinate role of “quantifying theories” presumed to be true. In this conception, whether in the classical (nineteenth-century) or neoclassical (twentieth-century) historical period or even in contemporary textbook econometrics, data do not so much test as allow instantiating theories: sophisticated econometric methods enable elaborate ways “to beat data into line” (as Kuhn would say) to accord with an assumed theory.

Type
Chapter
Information
Error and Inference
Recent Exchanges on Experimental Reasoning, Reliability, and the Objectivity and Rationality of Science
 , pp. 202 - 246
Publisher: Cambridge University Press
Print publication year: 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Abadir, K., and Talmain, , , G. (2002), “Aggregation, Persistence and Volatility in a Macro Model,” Review of Economic Studies, 69: 749–79.CrossRefGoogle Scholar
Backhouse, R.E. (2002), The Penguin History of Economics, Penguin, London.Google Scholar
Blaug, M. (1958), Ricardian Economics: A Historical Study, Yale University Press, New Haven, CT.Google Scholar
Boulding, K. (1970), Economics as a Science, McGraw-Hill, New York.Google Scholar
Bowley, A.L. (1924), The Mathematical Groundwork of Economics, Reprints of Economic Classics, 1960, Augustus, M. Kelley, New York.Google Scholar
Bowley, A.L. (1926), Elements of Statistics, 5th ed. Staples Press, London.Google Scholar
Box, G.E.P., and Jenkins, , , G.M. (1970), Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco, CA.Google Scholar
Brown, E.H.P. (1972), “The Underdevelopment of Economics,” Economic Journal, 82: 1–10.CrossRefGoogle Scholar
Cairnes, J.E. (1888), The Character and Logical Method of Political Economy, Reprints of Economic Classics, 1965, Augustus, M. Kelley, New York.Google Scholar
Caldwell, B. (1984), Appraisal and Criticism in Economics: A Book of Readings, Allen & Unwin, London.Google Scholar
Campos, J., Ericsson, N.R., and Hendry, D.F. (eds.) (2005), General-to-Specific Modeling, Vol. 1–2, Edward Elgar, Northampton, MA.
Christ, C.F. (1951), “A Test of an Econometric Model for the United States 1921–1947,” in NBER Conference on Business Cycles, NBER, New York.Google Scholar
Cooper, R.L. (1972), “The Predictive Performance of Quarterly Econometric Models of the United States,” in Hickman, B.G., Econometric Models of Cyclical Behavior, Columbia University Press, New York.Google Scholar
Cox, D.R., and Hinkley, , , D.V. (1974), Theoretical Statistics, Chapman & Hall, London.CrossRefGoogle Scholar
Desrosières, A. (1998), The Politics of Large Numbers: A History of Statistical Reasoning, Harvard University Press, Cambridge, MA.Google Scholar
Doob, J.L. (1953), Stochastic Processes, Wiley, New York.Google Scholar
Ekelund, R.B. and Hebert, R.F. (1975), A History of Economic Theory and Method, McGraw-Hill, New York.Google Scholar
Epstein, R.J. (1987), A History of Econometrics, North Holland, Amsterdam.Google Scholar
Fisher, R.A. (1921), “On the ‘Probable Error’ of a Coefficient Deduced from a Small Sample,” Metron, 1: 2–32.Google Scholar
Fisher, R.A. (1922), “On the Mathematical Foundations of Theoretical Statistics,” Philosophical Transactions of the Royal Society A, 222: 309–68.CrossRefGoogle Scholar
Fisher, R.A. (1925), Statistical Methods for Research Workers, Oliver & Boyd, Edinburgh.Google Scholar
Fisher, R.A. (1935), The Design of Experiments, Oliver & Boyd, Edinburgh.Google Scholar
Friedman, M. (1953), “The Methodology of Positive Economics,” pp. 3–43 in Essays in Positive Economics, Chicago University Press, Chicago.Google Scholar
Frisch, R. (1933), “Editorial,” Econometrica, 1: 1–4.Google Scholar
Frisch, R. (1934), Statistical Confluence Analysis by Means of Complete Regression Schemes, Universitetets Okonomiske Institutt, Oslo.Google Scholar
Goldberger, A.S. (1964), Econometric Theory, Wiley, New York.Google Scholar
Granger, C.W.J., ed. (1990), Modelling Economic Series, Clarendon Press, Oxford.
Granger, C.W.J., and Newbold, , , P. (1986), Forecasting Economic Time Series, 2nd ed., Academic Press, London.Google Scholar
Greene, W.H. (2003), Econometric Analysis, 5th ed., Prentice Hall, Upper Saddle River, NJ.Google Scholar
Guala, F. (2005), The Methodology of Experimental Economics, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Haavelmo, T. (1943), “The Statistical Implications of a System of Simultaneous Equations,” Econometrica, 11: 1–12.CrossRefGoogle Scholar
Haavelmo, T. (1944), “The Probability Approach to Econometrics,” Econometrica, 12(Suppl): 1–115.CrossRefGoogle Scholar
Hacking, I. (1983), Representing and Intervening: Introductory Topics in the Philosophy of Natural Science, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Hendry, D.F. (1980), “Econometrics – Alchemy or Science?” Economica, 47: 387–406.CrossRefGoogle Scholar
Hendry, D.F. (1995), Dynamic Econometrics, Oxford University Press, Oxford.CrossRefGoogle Scholar
Hendry, D.F. (2000), Econometrics: Alchemy or Science?Blackwell, Oxford.CrossRefGoogle Scholar
Hendry, D.F., and Morgan, M.S. (eds.) (1995), The Foundations of Econometric Analysis, Cambridge University Press, Cambridge.CrossRef
Hood, W.C., and Koopmans, T.C. (eds.) (1953), Studies in Econometric Method, Cowles Commission Monograph, No. 14, Wiley, New York.
Hoover, K.D. (2001a), Causality in Macroeconomics, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Hoover, K.D. (2001b), The Methodology of Empirical Macroeconomics, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Hoover, K.D. (2006), “The Methodology of Econometrics,” pp. 61–87, in Mills, T.C. and Patterson, K. (eds.), New Palgrave Handbook of Econometrics, vol. 1, Macmillan, London.Google Scholar
Hutchison, T.W. (1938), The Significance and Basic Postulates of Economic Theory, Reprints of Economic Classics, 1965, Augustus, M. Kelley, New York.Google Scholar
Jevons, W.S. (1871), The Theory of Political Economy, 4th ed. 1911, Reprints of Economic Classics, 1965, Augustus M. Kelley, New York.Google Scholar
Johnston, J. (1963), Econometric Methods, McGraw-Hill, New York.Google Scholar
Kalman, R.E. (1982), “System Identification from Noisy Data,” in Bednarek, A.R. and Cesari, L. (eds.), Dynamic Systems II, Academic Press, London.Google Scholar
Kennedy, P. (2003), A Guide to Econometrics, 5th ed., MIT Press, Cambridge.Google Scholar
Keynes, J.N. (1890), The Scope and Method of Political Economy, 2nd ed. 1917, Reprints of Economic Classics, 1986, Augustus M. Kelley, New York.Google Scholar
Klein, L.R. (1950), Economic Fluctuations in the United States 1921–1941. Cowles Commission for Research in Economics, Monograph No. 11, Wiley, New York.Google Scholar
Klein, L.R. (1962), An Introduction to Econometrics, Prentice Hall, Upper Saddle River, NJ.Google Scholar
Koopmans, T.C. (1950), Statistical Inference in Dynamic Economic Models, Cowles Commission Monograph, No. 10, Wiley, New York.Google Scholar
Kydland, F., and Prescott, P. (1991), “The Econometrics of the General Equilibrium Approach to Business Cycles,” Scandinavian Journal of Economics, 93: 161–178.CrossRefGoogle Scholar
Leamer, E.E. (1978), Specification Searches: Ad Hoc Inference with Nonexperimental Data, Wiley, New York.Google Scholar
Leamer, E.E., and Leonard, H.B. (1983), “Reporting the Fragility of Regression Estimates,” Review of Economics and Statistics, 65: 306–317.CrossRefGoogle Scholar
Lehmann, E.L. (1986), Testing Statistical Hypotheses, 2nd ed., Wiley, New York.CrossRefGoogle Scholar
Leontief, W.W. (1971), “Theoretical Assumptions and Nonobserved Facts,” American Economic Review, 61: 1–7.Google Scholar
Lucas, R.E. (1976), “Econometric Policy Evaluation: A Critique,” pp. 19–46 in Brunner, K. and Metzer, A.M. (eds.), The Phillips Curve and Labour Markets, Carnegie-Rochester Conference on Public Policy, I, North-Holland, Amsterdam.Google Scholar
Lucas, R.E., and Sargent, T.J. (1981), Rational Expectations and Econometric Practice, George Allen & Unwin, London.Google Scholar
Machlup, F. (1963), Essays in Economic Semantic, Prentice Hall, Upper Saddle River, NJ.Google Scholar
Maki, U. (ed.) (2009), The Methodology of Positive Economics: Reflections on the Milton Friedman Legacy, Cambridge University Press, Cambridge.CrossRef
Malthus, T. R. (1936), Principles of Political Economy, Reprints of Economic Classics, 1986, Augustus M. Kelley, New York.Google Scholar
Marshall, A. (1891/1920), Principles of Economics, 8th ed., Macmillan, London.Google Scholar
Mayo, D.G. (1996), Error and the Growth of Experimental Knowledge, University of Chicago Press, Chicago.CrossRefGoogle Scholar
Mayo, D.G. (2008), “Some Methodological Issues in Experimental Economics,” Philosophy of Science, 75: 633–45.CrossRefGoogle Scholar
Mayo, D.G., and Spanos, A. (2004), “Methodology in Practice: Statistical Misspecification Testing,” Philosophy of Science, 71: 1007–25.CrossRefGoogle Scholar
Mayo, D.G., and Spanos, A. (2006), “Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction,” British Journal for the Philosophy of Science, 57: 323–57.CrossRefGoogle Scholar
Mayo, D.G., and Spanos, A. (2009), “Error Statistics,” forthcoming in Gabbay, D., Thagard, P., and Woods, J. (eds.), Philosophy of Statistics, Handbook of Philosophy of Science, Elsevier.Google Scholar
McCloskey, D.N. (1985), The Rhetoric of Economics, University of Wisconsin, Madison.Google Scholar
McCulloch, J.R. (1864), The Principles of Political Economy, Reprints of Economic Classics, 1965, Augustus M. Kelley, New York.Google Scholar
Mill, J.S. (1844), Essays on Some Unsettled Questions of Political Economy, Reprints of Economic Classics, 1974, Augustus M. Kelley, New York.Google Scholar
Mill, J.S. (1871), Principles of Political Economy, Reprints of Economic Classics, 1976, Augustus M. Kelley, New York.Google Scholar
Mill, J.S. (1888), A System of Logic, Ratiocinative and Inductive, 8th ed., Harper & Bros., New York.Google Scholar
Mills, F.C. (1924), Statistical Methods (reprinted 1938), Henry Holt, New York.Google Scholar
Mirowski, P. (1994), “What Are the Questions?” pp. 50–74 in Backhouse, R.E. (ed.), New Directions in Economic Methodology, Routledge, London.Google Scholar
Morgan, M.S. (1990), The History of Econometric Ideas, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Morgenstern, O. (1950/1963), On the Accuracy of Economic Observations, 2nd ed., Princeton University Press, NJ.Google Scholar
Musgrave, A. (1981), “Unreal Assumptions in Economic Theory: The F-Twist Untwisted,” Kyklos, 34: 377–87.CrossRefGoogle Scholar
Nagel, E. (1963), “Assumptions in Economic Theory,” American Economic Review, 53: 211–219.Google Scholar
Neyman, J. (1950), First Course in Probability and Statistics, Henry Holt, New York.Google Scholar
Neyman, J. (1977), “Frequentist Probability and Frequentist Statistics,” Synthèse, 36: 97–131.CrossRefGoogle Scholar
Neyman, J., and Pearson, E.S. (1928), “On the Use and Interpretation of Certain Test Criteria for the Purposes of Statistical Inference,” Parts I and II, Biometrika, 20A: 175–240, 263–94.Google Scholar
Neyman, J., and Pearson, E.S. (1933), “On the Problem of the Most Efficient Tests of Statistical Hypotheses,” Philosophical Transactions of the Royal Society of London, A, 231: 289–337.CrossRefGoogle Scholar
Pearson, E.S. (1966), “The Neyman–Pearson Story: 1926–34,” In David, F.N. (ed.), Research Papers in Statistics: Festschrift for J. Neyman, Wiley, New York.Google Scholar
Porter, G.R. (1836/1912), The Progress of a Nation, 2nd ed., 1912, Reprints of Economic Classics, 1970, Augustus M. Kelley, New York.Google Scholar
Quetelet, A. (1942), A Treatise on Man and the Development of His Faculties, Chambers, Edinburgh.Google Scholar
Redman, D. A. (1991), Economics and the Philosophy of Science, Oxford University Press, Oxford.Google Scholar
Ricardo, D. (1817), Principles of Political Economy and Taxation, vol. 1 of The Collected Works of David Ricardo, Sraffa, P. and Dobb, M. (eds.), Cambridge University Press, Cambridge.Google Scholar
Robbins, L. (1932), An Essay on the Nature and Significance of Economic Science, 2nd ed. 1935, Macmillan, London.Google Scholar
Robbins, L. (1971), Autobiography of an Economist, Macmillan, London.CrossRefGoogle Scholar
Sargan, J. D. (1964), “Wages and Prices in the United Kingdom: A Study in Econometric Methodology,” in Hart, P.E., Mills, G., and Whitaker, J.K. (eds.), Econometric Analysis for Economic Planning, Butterworths, London.Google Scholar
Sargent, T. (1976), “A Classical Macroeconomic Model for the United States,” Journal of Political Economy, 84: 207–38.CrossRefGoogle Scholar
Senior, N.W. (1836), An Outline of the Science of Political Economy, Reprints of Economic Classics, 1965, Augustus M. Kelley, New York.Google Scholar
Sims, C.A. (1980), “Macroeconomics and Reality,” Econometrica, 48: 1–48.CrossRefGoogle Scholar
Smith, A. (1776), An Inquiry into the Nature and Causes of the Wealth of Nations, Campell, R.H., Skinner, A.S., and Todd, W.B. (eds.), Clarendon Press, Oxford.CrossRefGoogle Scholar
Smith, V.L. (2007), Rationality in Economics: Constructivist and Ecological Forms, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Sowell, T. (2006), On Classical Economics, Yale University Press, New Haven, CT.Google Scholar
Spanos, A. (1986), Statistical Foundations of Econometric Modelling, Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Spanos, A. (1989), “On Re-reading Haavelmo: A Retrospective View of Econometric Modeling,” Econometric Theory, 5: 405–29.CrossRefGoogle Scholar
Spanos, A. (1990), “The Simultaneous Equations Model Revisited: Statistical Adequacy and Identification,” Journal of Econometrics, 44: 87–108.CrossRefGoogle Scholar
Spanos, A. (1995), “On Theory Testing in Econometrics: Modeling with Nonexperimental Data,” Journal of Econometrics, 67: 189–226.CrossRefGoogle Scholar
Spanos, A. (1999), “Probability Theory and Statistical Inference: Econometric Modeling with Observational Data,” Cambridge University Press, Cambridge.
Spanos, A. (2000), “Revisiting Data Mining: ‘Hunting’ with or without a License,” Journal of Economic Methodology, 7: 231–64.CrossRefGoogle Scholar
Spanos, A. (2005), “Misspecification, Robustness and the Reliability of Inference: the Simple T-Test in the Presence of Markov Dependence,” Working Paper, Virginia Tech.
Spanos, A. (2006a), “Econometrics in Retrospect and Prospect,” pp. 3–58 in Mills, T.C. and Patterson, K. (eds.), New Palgrave Handbook of Econometrics, vol. 1, Macmillan, London.Google Scholar
Spanos, A. (2006b), “Revisiting the Omitted Variables Argument: Substantive vs. Statistical Adequacy,” Journal of Economic Methodology, 13: 179–218.CrossRefGoogle Scholar
Spanos, A. (2006c), “Where Do Statistical Models Come From? Revisiting the Problem of Specification,” in Rojo, J. (ed.), Optimality: The Second Erich L. Lehmann Symposium, Lecture Notes-Monograph Series, vol. 49, Institute of Mathematical Statistics, Beachwood, OH.Google Scholar
Spanos, A. (2009), “The Pre-Eminence of Theory vs. the European CVAR Perspective in Macroeconometric Modeling”, in The Open-Access, Open-Assessment E-Journal, 3, 2009-10. http://www.economics-ejournal.org/economics/journalarticles/2009-10.Google Scholar
Spanos, A. (2010), “Philosophy of Econometrics,” forthcoming in Gabbay, D., Thagard, P., and Woods, J. (eds.), Philosophy of Economics, the Handbook of Philosophy of Science, Elsevier, North-Holland, Amsterdam.Google Scholar
Spanos, A., and McGuirk, A. (2001), “The Model Specification Problem from a Probabilistic Reduction Perspective,” Journal of the American Agricultural Association, 83: 1168–76.CrossRefGoogle Scholar
Sugden, R. (2005), “Experiments as Exhibits and Experiments as Tests,” Journal of Economic Methodology, 12: 291–302.CrossRefGoogle Scholar
Sugden, R. (2008), “The Changing Relationship between Theory and Experiment in Economics,” Philosophy of Science, 75: 621–32.CrossRefGoogle Scholar
Worswick, G.D.N. (1972), “Is Progress in Economic Science Possible?” Economic Journal, 82: 73–86.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×