Book contents
- Frontmatter
- Contents
- Preface
- 1 Basic Concepts in Probability and Statistics
- 2 Hypothesis Tests
- 3 Confidence Intervals
- 4 Statistical Tests Based on Ranks
- 5 Introduction to Stochastic Processes
- 6 The Power Spectrum
- 7 Introduction to Multivariate Methods
- 8 Linear Regression: Least Squares Estimation
- 9 Linear Regression: Inference
- 10 Model Selection
- 11 Screening: A Pitfall in Statistics
- 12 Principal Component Analysis
- 13 Field Significance
- 14 Multivariate Linear Regression
- 15 Canonical Correlation Analysis
- 16 Covariance Discriminant Analysis
- 17 Analysis of Variance and Predictability
- 18 Predictable Component Analysis
- 19 Extreme Value Theory
- 20 Data Assimilation
- 21 Ensemble Square Root Filters
- Appendix
- References
- Index
9 - Linear Regression: Inference
Published online by Cambridge University Press: 03 February 2022
- Frontmatter
- Contents
- Preface
- 1 Basic Concepts in Probability and Statistics
- 2 Hypothesis Tests
- 3 Confidence Intervals
- 4 Statistical Tests Based on Ranks
- 5 Introduction to Stochastic Processes
- 6 The Power Spectrum
- 7 Introduction to Multivariate Methods
- 8 Linear Regression: Least Squares Estimation
- 9 Linear Regression: Inference
- 10 Model Selection
- 11 Screening: A Pitfall in Statistics
- 12 Principal Component Analysis
- 13 Field Significance
- 14 Multivariate Linear Regression
- 15 Canonical Correlation Analysis
- 16 Covariance Discriminant Analysis
- 17 Analysis of Variance and Predictability
- 18 Predictable Component Analysis
- 19 Extreme Value Theory
- 20 Data Assimilation
- 21 Ensemble Square Root Filters
- Appendix
- References
- Index
Summary
The method of least squares will fit any model to a data set, but is the resulting model "good"?One criterion is that the model should fit the data significantly better than a simpler model with fewer predictors. After all, if the fit is not significantly better, then the model with fewer predictors is almost as good. For linear models, this approach is equivalent to testing if selected regression parameters vanish. This chapter discusses procedures for testing such hypotheses. In interpreting such hypotheses, it is important to recognize that a regression parameter for a given predictor quantifies the expected rate of change of the predict and while holding the other predictors constant. Equivalently, the regression parameter quantifies the dependence between two variables after controlling or regressing out other predictors. These concepts are important for identifying a confounding variable, which is a third variable that influences two variables to produce a correlation between those two variables. This chapter also discusses how detection and attribution of climate change can be framed in a regression model framework.
Keywords
- Type
- Chapter
- Information
- Statistical Methods for Climate Scientists , pp. 210 - 236Publisher: Cambridge University PressPrint publication year: 2022