Book contents
- Frontmatter
- Contents
- Preface
- 1 Basic Concepts in Probability and Statistics
- 2 Hypothesis Tests
- 3 Confidence Intervals
- 4 Statistical Tests Based on Ranks
- 5 Introduction to Stochastic Processes
- 6 The Power Spectrum
- 7 Introduction to Multivariate Methods
- 8 Linear Regression: Least Squares Estimation
- 9 Linear Regression: Inference
- 10 Model Selection
- 11 Screening: A Pitfall in Statistics
- 12 Principal Component Analysis
- 13 Field Significance
- 14 Multivariate Linear Regression
- 15 Canonical Correlation Analysis
- 16 Covariance Discriminant Analysis
- 17 Analysis of Variance and Predictability
- 18 Predictable Component Analysis
- 19 Extreme Value Theory
- 20 Data Assimilation
- 21 Ensemble Square Root Filters
- Appendix
- References
- Index
14 - Multivariate Linear Regression
Published online by Cambridge University Press: 03 February 2022
- Frontmatter
- Contents
- Preface
- 1 Basic Concepts in Probability and Statistics
- 2 Hypothesis Tests
- 3 Confidence Intervals
- 4 Statistical Tests Based on Ranks
- 5 Introduction to Stochastic Processes
- 6 The Power Spectrum
- 7 Introduction to Multivariate Methods
- 8 Linear Regression: Least Squares Estimation
- 9 Linear Regression: Inference
- 10 Model Selection
- 11 Screening: A Pitfall in Statistics
- 12 Principal Component Analysis
- 13 Field Significance
- 14 Multivariate Linear Regression
- 15 Canonical Correlation Analysis
- 16 Covariance Discriminant Analysis
- 17 Analysis of Variance and Predictability
- 18 Predictable Component Analysis
- 19 Extreme Value Theory
- 20 Data Assimilation
- 21 Ensemble Square Root Filters
- Appendix
- References
- Index
Summary
Multivariate linear regression is a method for modeling linear relations between two random vectors, say X and Y. Common reasons for using multivariate regression include (1) to predicting Y given X, (2) to testing hypotheses about the relation between X and Y, and (3) to projecting Y onto prescribed time series or spatial patterns. Special cases of multivariate regression models include Linear Inverse Models (LIMs) and Vector Autoregressive Models. Multivariate regression also is fundamental to other statistical techniques, including canonical correlation analysis, discriminant analysis, and predictable component analysis. This chapter introduces multivariate linear regression and discusses estimation, measures of association, hypothesis testing, and model selection. In climate studies, model selection often involves selecting Y as well as X. For instance, Y may be a set of principal components that need to be chosen, which is not a standard selection problem. This chapter introduces a criterion for selecting X and Y simultaneously called Mutual Information Criterion (MIC).
Keywords
- Type
- Chapter
- Information
- Statistical Methods for Climate Scientists , pp. 314 - 334Publisher: Cambridge University PressPrint publication year: 2022