Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-27T18:16:56.908Z Has data issue: false hasContentIssue false

LARGE SYSTEM OF SEEMINGLY UNRELATED REGRESSIONS: A PENALIZED QUASI-MAXIMUM LIKELIHOOD ESTIMATION PERSPECTIVE

Published online by Cambridge University Press:  27 May 2019

Qingliang Fan*
Affiliation:
Xiamen University
Xiao Han
Affiliation:
Nanyang Technological University
Guangming Pan
Affiliation:
Nanyang Technological University
Bibo Jiang
Affiliation:
Pennsylvania State University
*
*Address correspondence to Qingliang Fan, MOE Key Lab of Econometrics, Wang Yanan Institute of Studies in Economics (WISE) and School of Economics, Xiamen University, D312 Economics Bldg, Xiamen University, Xiamen 361005, China; e-mail: [email protected].

Abstract

In this article, using a shrinkage estimator, we propose a penalized quasi-maximum likelihood estimator (PQMLE) to estimate a large system of equations in seemingly unrelated regression models, where the number of equations is large relative to the sample size. We develop the asymptotic properties of the PQMLE for both the error covariance matrix and model coefficients. In particular, we derive the asymptotic distribution of the coefficient estimator and the convergence rate of the estimated covariance matrix in terms of the Frobenius norm. The model selection consistency of the covariance matrix estimator is also established. Simulation results show that when the number of equations is large relative to the sample size and the error covariance matrix is sparse, the PQMLE outperforms other contemporary estimators.

Type
ARTICLES
Copyright
Copyright © Cambridge University Press 2019 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Thanks to Liangjun Su (co-editor) and two anonymous referees for their insightful comments and references, which have helped to greatly improve the earlier version of this article. We are grateful to Peter C. B. Phillips, M. Hashem Pesaran and seminar and conference participants from Singapore Management University, Peking University, SETA 2014, 4th IAAE conference, etc., for their helpful comments. Qingliang Fan acknowledges support of the National Natural Science Foundation of China (NSFC) grant 71671149, 71631004 (Key Project), and the Fundamental Research Funds for the Central Universities (Project No. 20720171042).

References

REFERENCES

Amemiya, T. (1977) The maximum likelihood and the nonlinear three-stage least squares estimator in the general nonlinear simultaneous equation model. Econometrica 45, 955968.CrossRefGoogle Scholar
An, L. & Tao, P. (2005) The DC (difference of convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems. Annals of Operation Research 133, 2346.CrossRefGoogle Scholar
Bai, Z.D. & Silverstein, J.W. (2006) Spectral Analysis of Large Dimensional Random Matrices. 1st ed. Springer.Google Scholar
Bailey, N., Pesaran, M.H., & Smith, L.V. (2016) A Multiple Testing Approach to the Regularisation of Large Sample Correlation Matrices. Working paper.Google Scholar
Baltagi, B. & Bresson, G. (2011) Maximum likelihood estimation and Lagrange multiplier tests for panel seemingly unrelated regressions with spatial lag and spatial errors: An application to hedonic housing prices in Paris. Journal of Urban Economics 69, 2442.CrossRefGoogle Scholar
Bewley, R.A. (1983) Tests of restrictions in large demand systems. European Economic Review 20, 257269.CrossRefGoogle Scholar
Bickel, P. & Levina, E. (2008) Regularized estimation of large covariance matrices. The Annals of Statistics 36, 199227.CrossRefGoogle Scholar
Bien, J. & Tibshirani, R. (2011) Sparse estimation of a covariance matrix. Biometrika 984, 807820.CrossRefGoogle Scholar
Cai, T. & Liu, W. (2011) Adaptive thresholding for sparse covariance matrix estimation. Journal of American Statistical Association 106, 672684.CrossRefGoogle Scholar
Cai, T., Zhang, C., & Zhou, H. (2010) Optimal rates of convergence for covariance matrix estimation. The Annals of Statistics 38, 21182144.CrossRefGoogle Scholar
Chen, B.B. & Pan, G.M. (2012) Convergence of the largest eigenvalue of normalized sample covariance matrices when p and n both tend to infinity with their ratio converging to zero. Bernoulli 18, 14051420.CrossRefGoogle Scholar
Daniel, K., Titman, S., & Wei, K.C. (2001) Explaining the cross-section of stock returns in Japan: Factors or characteristics? The Journal of Finance 56, 743766.CrossRefGoogle Scholar
Dufour, J. & Khalaf, L. (2002) Exact tests for contemporaneous correlation of disturbances in seemingly unrelated regressions. Journal of Econometrics 106, 143170.CrossRefGoogle Scholar
Elberg, A. (2016) Sticky prices and deviations from the law of one price: Evidence from Mexican micro-price data. Journal of International Economics 98, 191203.CrossRefGoogle Scholar
El Karoui, N. (2008) Operator norm consistent estimation of large-dimensional sparse covariance matrices. The Annals of Statistics 36, 27172756.CrossRefGoogle Scholar
Fan, J., Fan, Y., & Lv, J. (2008) High dimensional covariance matrix estimation using a factor model. Journal of Econometrics 147, 186197.CrossRefGoogle Scholar
Fan, J., Liao, Y., & Mincheva, M. (2013) Large covariance estimation by thresholding principal orthogonal complements. Journal of Royal Statistical Association Series B 75, 603680.CrossRefGoogle ScholarPubMed
Fan, Q. & Zhong, W. (2018) Nonparametric additive instrumental variable estimator: A group shrinkage estimation perspective. Journal of Business & Economic Statistics 36, 388399.CrossRefGoogle Scholar
Grama, I. G. (1997) On moderate deviations for martingales. The Annals of Probability 25, 152183.Google Scholar
Hafner, C., Linton, O., & Tang, H. (2016) Estimation of a Multiplicative Covariance Structure in the Large Dimensional Case. Working paper.CrossRefGoogle Scholar
Henderson, D.J., Kumbhakar, S.C., Li, Q., & Parmeter, C.F. (2015) Smooth coefficient estimation of a seemingly unrelated regression. Journal of Econometrics 189, 148162.CrossRefGoogle Scholar
Hunter, D. & Li, R. (2005) Variable selection using MM algorithms. Annals of Statistics 33, 16171642.CrossRefGoogle ScholarPubMed
Imbs, J., Mumtaz, H., Ravn, M.O., & Rey, H. (2005) PPP strikes back: Aggregation and the real exchange rate. The Quarterly Journal of Economics 120, 143.Google Scholar
Lam, C. & Fan, J. (2009) Sparsistency and rates of convergence in large covariance matrix estimation. Annals of Statistics 37, 42544278.CrossRefGoogle ScholarPubMed
Lange, K. (2004) Optimization. 2nd ed, Springer.CrossRefGoogle Scholar
Ledoit, O. & Wolf, M. (2004) A well-conditioned estimator for large-dimensional covariance matrices. Journal of Multivariate Analysis 88, 365411.CrossRefGoogle Scholar
Ledoit, O. & Wolf, M. (2012) Nonlinear shrinkage estimation of large-dimensional covariance matrices. Annals of Statistics 40, 10241060.CrossRefGoogle Scholar
Lu, X., Su, L., & White, H. (2017) Granger causality and structural causality in cross-section and panel data. Econometric Theory 33, 263291.CrossRefGoogle Scholar
Ma, S., Lan, W., Su, L., & Tsai, C.-L. (2018) Testing alphas in conditional time-varying factor models with high dimensional assets. Journal of Business & Economic Statistics, forthcoming.Google Scholar
Moon, H.R. (1999) A note on fully-modified estimation of seemingly unrelated regressions models with integrated regressors. Economics Letters 65, 2531.CrossRefGoogle Scholar
Pástor, L̆. & Stambaugh, R.F. (2002) Mutual fund performance and seemingly unrelated assets. Journal of Financial Economics 63, 315349.CrossRefGoogle Scholar
Pesaran, M.H. & Yamagata, T. (2017) Testing for Alpha in Linear Factor Pricing Models with a Large Number of Securities. Working paper.CrossRefGoogle Scholar
Phillips, P.C.B. (1985) The exact distribution of the SUR estimator. Econometrica 53, 745756.CrossRefGoogle Scholar
Stein, C. (1956) Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Lehmann, E.L. (ed.), Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, vol. I, pp. 197206. University of California Press.Google Scholar
Su, L., Shi, Z., & Phillips, P.C.B. (2016) Identifying latent structures in panel data. Econometrica 84, 22152264.CrossRefGoogle Scholar
Su, L. & Ullah, A. (2009) Testing conditional uncorrelatedness. Journal of Business & Economic Statistics 27, 1829.CrossRefGoogle Scholar
Wong, F., Carter, C.K., & Kohn, R. (2003) Efficient estimation of covariance selection models. Biometrika 90, 809830.CrossRefGoogle Scholar
Zellner, A. (1962) An efficient method of estimating seemingly unrelated regressions and tests of aggregation bias. Journal of the American Statistical Association 57, 348368.CrossRefGoogle Scholar
Supplementary material: PDF

Fan et al. supplementary material

Online Supplement

Download Fan et al. supplementary material(PDF)
PDF 310 KB