Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-27T19:16:39.196Z Has data issue: false hasContentIssue false

A Unified Theory of Consistent Estimation for Parametric Models

Published online by Cambridge University Press:  18 October 2010

Charles Bates
Affiliation:
Johns Hopkins University
Halbert White
Affiliation:
University of California at San Diego and Massachusetts Institute of Technology

Abstract

We present a general theory of consistent estimation for possibly misspecified parametric models based on recent results of Domowitz and White. This theory extends the unification of Burguete, Gallant, and Souza by allowing for heterogeneous, time-dependent data and dynamic models. The theory is applied to yield consistency results for quasi-maximum-likelihood and method of moments estimators. Of particular interest is a new generalized rank condition for identifiability.

Type
Articles
Copyright
Copyright © Cambridge University Press 1985

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

1.Akaike, H. Information theory and an extension of the likelihood principle. In Petrov, B. N. and Csaki, F. (eds.), Proceedings of the Second International Symposium on Information Theory. Budapest: Akademiai Kiado, 1973.Google Scholar
2.Amemiya, T.Regression analysis when the dependent variable is truncated normal. Eco-nometrica 41 (1973): 9971016.Google Scholar
3.Amemiya, T.The nonlinear two-stage least-squares estimator. Journal of Econometrics 2 (1974): 105110.CrossRefGoogle Scholar
4.Amemiya, T.The maximum likelihood and nonlinear three-stage least-squares estimator in the general nonlinear simultaneous equations model. Econometrica 45 (1977): 955968.CrossRefGoogle Scholar
5.Andersen, E. B.Asymptotic properties of conditional maximum likelihood estimators. Journal of the Royal Statistical Society Series B 32 (1970): 283301.Google Scholar
6.Bar-Shalom, Y.On the asymptotic properties of the maximum likelihood estimate obtained from dependent observations. Journal of the Royal Statistical Society Series B 33 (1971): 7277.Google Scholar
7.Bates, C. and White, H. Efficient estimation of parametric models. Johns Hopkins Department of Political Economy Discussion Paper (1984).Google Scholar
8.Berk, H.Limiting behavior of posterior distributions when the model is incorrect. Annals of Mathematical Statistics 37 (1966): 5158.CrossRefGoogle Scholar
9.Berk, H.Consistency a priori. Annals of Mathematical Statistics 41 (1970): 894906.CrossRefGoogle Scholar
10.Bhat, B. R.On the method of maximum likelihood for dependent observations. Journal of the Royal Statistical Society Series B 36 (1974): 4853.Google Scholar
11.Billingsley, P.Probability and Measure. New York: Wiley, 1979.Google Scholar
12.Burguete, J. A. R., Gallant and Souza, G.On the unification of the asymptotic theory of nonlinear econometric models. Econometric Reviews 1 (1982): 151212.CrossRefGoogle Scholar
13.Caines, P.A note on the consistency of maximum likelihood estimates for finite families of stochastic processes. The Annals of Statistics 3(1975): 539546.CrossRefGoogle Scholar
14.Cramer, H.Mathematical Methods of Statistics. Princeton: Princeton University Press, 1946.Google Scholar
15.Crowder, M.Maximum likelihood estimation for dependent observations. Journal of the Royal Statistical Society Series B 38 (1976): 4553.Google Scholar
16.Doob, J. L.Probability and statistics. Transactions of the American Mathematical Society 36 (1934): 759775.CrossRefGoogle Scholar
17.Domowitz, I. and White, H.Misspecified models with dependent observations. Journal of Econometrics 20 (1982): 3558.CrossRefGoogle Scholar
18.Fisher, F.The Identification Problem in Econometrics. New York: McGraw-Hill, 1966.Google Scholar
19.Fisher, R. A.On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London Series A 222 (1922): 309368.Google Scholar
20.Fisher, R. A.Theory of statistical estimation. Proceedings of the Cambridge Philosophical Society 22 (1925): 700725.CrossRefGoogle Scholar
21.Gallant, A. R.Three-stage least-squares estimation for a system of simultaneous, nonlinear, implicit equations. Journal of Econometrics 5 (1977): 7188.CrossRefGoogle Scholar
22.Gallant, A. R. and White, H. A unified theory of estimation and inference for nonlinear dynamic models. UCSD Department of Economics Discussion Paper (1985).Google Scholar
23.Geary, R.Determination of linear relations between systematic parts of variables with errors of observation, the variances of which are unknown. Econometrica 17 (1949): 3058.CrossRefGoogle Scholar
24.Hall, P. and Heyde, C.Martingale Limit Theory and Its Applications. New York: Academic, 1980.Google Scholar
25.Hansen, L.Large sample properties of generalized method of moments estimators. Econo-metrica 50 (1982): 10291054.CrossRefGoogle Scholar
26.Heijmans, R. and Magnus, J.Consistency of maximu m likelihood estimators when observations are dependent. University of Amsterdam Faculty of Actuarial Science and Econometrics Report No. AE 11/83 (1983).Google Scholar
26.Hoadley, B.Asymptotic properties of maximum likelihood estimators for the independent not identically distributed case. Annals of Mathematical Statistics 41 (1971): 1977–1991.Google Scholar
28.Huber, P. The behavior of Maximum likelihood estimates under nonstandard conditions. In Proceedings of the Fifth Berkeley Symposium in Mathematical Statistics and Probability. Berkeley: University of California Press, 1967.Google Scholar
29.Jennrich, R. I.Asymptotic properties of non-linear least-squares estimators. Annals of Mathematical Statistics 40 (1969): 633643.CrossRefGoogle Scholar
30.Jorgenson, D. W. and Laffont, J.. Efficient estimation of nonlinear simultaneous equations with additive disturbances. Annals of Economic and Social Measurement 3 (1974): 615640.Google Scholar
31.Kullback, S. and Leibler, R. A.On information and sufficiency. Annals of Mathematical Statistics 22 (1951): 7986.CrossRefGoogle Scholar
32.Le Cam, L.On some asymptotic properties of maximum, likelihood estimates and related Bayes estimates. University of California Publications in Statistics 1 (1953): 277328.Google Scholar
33.Levine, D.A remark on serial correlation in maximum likelihood. Journal of Econometrics 23 (1983): 337342.CrossRefGoogle Scholar
34.McLeish, D. L.A maximal inequality and dependent strong laws. Annals of Probability 3(1975): 826836.CrossRefGoogle Scholar
35.Rao, R.Ranga, Relations between weak and uniform convergence of measures with applications. Annals of Mathematical Statistics 33 (1962): 659680.CrossRefGoogle Scholar
36.Reiersøl, O.Confluence analysis by means of instrumental sets of variables. Arkiv foer Matematik, Astronomi och Fysik 32 (1945): 1119.Google Scholar
37.Roberts, A. and Varberg, D.Convex Functions. New York: Academic, 1973.Google Scholar
38.Rothenberg, T.Efficient Estimation with A Priori Information. New Haven: Yale University Press, 1973.Google Scholar
39.Silvey, S.A note on maximum likelihood in the case of dependent random variables. Journal of the Royal Statistical Society Series B 23 (1961): 444452.Google Scholar
40.Wald, A.Asymptotic properties of the maximum likelihood estimate of an unknown parameter of a discrete Stochastic process. Annals of Mathematical Statistics 19 (1948): 4046.CrossRefGoogle Scholar
41.Wald, A.Note on the consistency of the maximum likelihood estimate. Annals of Mathematical Statistics 20 (1949): 595601.Google Scholar
42.Weiss, L.Asymptotic properties of maximum likelihood in some nonstandard cases: I. Journal of the American Statistical Society 66 (1971): 345350.CrossRefGoogle Scholar
43.Weiss, L.Asymptotic properties of maximum likelihood in some nonstandard cases: II. Journal of the American Statistical Society 68 (1973): 428430.CrossRefGoogle Scholar
44.White, H.Using least squares to approximate unknown regression functions. International Economic Review 21 (1980): 149170.CrossRefGoogle Scholar
45.White, H.Nonlinear regression on cross-section data. Econometrica 48 (1980): 721746.CrossRefGoogle Scholar
46.White, H.Consequences and detection of misspecified nonlinear regression models. Journal of the American Statistical Association 76 (1981): 419433.CrossRefGoogle Scholar
47.White, H.Maximum likelihood estimation of misspecified models. Econometrica 50 (1982): 126.CrossRefGoogle Scholar
48.White, H.Asymptotic Theory For Econometricians. New York: Academic, 1984.Google Scholar
49.White, H. Maximum likelihood estimation of misspecified dynamic models. In Dijkstra, Theo K. (ed.), Misspecification Analysis. New York: Springer, 1984.Google Scholar
50.White, H.Estimation, Inference and Specification Analysis. New York: Cambridge University Press, forthcoming.CrossRefGoogle Scholar
51.White, H. and Domowitz, I.Nonlinear regression with dependent observations. Econo-metrica 52 (1984): 143162.CrossRefGoogle Scholar
52.Wooldridge, J. A general theory of estimation and inference for parametric models. Ph.D. Thesis, University of California at San Diego (1985).Google Scholar