Skip to main content Accessibility help
×
Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-28T05:31:16.983Z Has data issue: false hasContentIssue false

15 - Generalized Additive Models and Nonparametric Regression

from III - Bayesian and Mixed Modeling

Published online by Cambridge University Press:  05 August 2014

Patrick L. Brockett
Affiliation:
University of Texas at Austin
Shuo-Li Chuang
Affiliation:
The University of Texas at Austin
Utai Pitaktong
Affiliation:
The University of Texas at Austin
Edward W. Frees
Affiliation:
University of Wisconsin, Madison
Richard A. Derrig
Affiliation:
Temple University, Philadelphia
Glenn Meyers
Affiliation:
ISO Innovative Analytics, New Jersey
Get access

Summary

Chapter Preview. Generalized additive models (GAMs) provide a further generalization of both linear regression and generalized linear models (GLM) by allowing the relationship between the response variable y and the individual predictor variables xj to be an additive but not necessarily a monomial function of the predictor variables xj. Also, as with the GLM, a nonlinear link function can connect the additive concatenation of the nonlinear functions of the predictors to the mean of the response variable, giving flexibility in distribution form, as discussed in Chapter 5. The key factors in creating the GAM are the determination and construction of the functions of the predictor variables (called smoothers). Different methods of fit and functional forms for the smoothers are discussed. The GAM can be considered as more data driven (to determine the smoothers) than model driven (the additive monomial functional form assumption in linear regression and GLM).

Motivation for Generalized Additive Models and Nonparametric Regression

Often for many statistical models there are two useful pieces of information that we would like to learn about the relationship between a response variable y and a set of possible available predictor variables x1, x2, …, xk for y: (1) the statistical strength or explanatory power of the predictors for influencing the response y (i.e., predictor variable worth) and (2) a formulation that gives us the ability to predict the value of the response variable ynew that would arise under a given set of new observed predictor variables x1,new, x2,new, …, xk,new (the prediction problem).

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Buja, A., T., Hastie, and R., Tibshirani (1989). Linear smoothers and additive models (with discussion). Annals of Statistics 17(2), 453–510.Google Scholar
Clark, M. (2013). Generalized Additive Models: Getting Started with Additive Models in R. Center for Social Research, University of Notre Dame, Available at http://www3.nd.edu/~mclark19/learn/GAMS.pdf.
Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association 74(368), 829–836.CrossRefGoogle Scholar
Cleveland, W. S. (1981). Lowess: A program for smoothing scatterplots by robust locally weighted regression. The American Statistician 35(1), 54.CrossRefGoogle Scholar
Craven, P. and G., Wahba (1979). Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation. Numerische Mathematik 31, 377–103.Google Scholar
Epanechnikov, V. A. (1969). Nonparametric estimation of a multidimensional probability density. Theory of Probability and its Application 14(1), 156–161.CrossRefGoogle Scholar
Eubank, R. L. (1999). Nonparametric Regression and Spline Smoothing (2nd ed.). Marcel Dekker, New York.Google Scholar
Golub, G. H., M., Heath, and G., Wahba (1979). Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21(2), 215–223.CrossRefGoogle Scholar
Hastie, T. J. and R. J., Tibshirani (1999). Generalized Additive Models. Chapman & Hall, Boca Raton, FL.Google Scholar
Johnson, M. L., V. L., Bengtson, P. G., Coleman, and T. B., Kirkwood (2005). The Cambridge Handbook of Age and Ageing. Cambridge University Press, Cambridge.CrossRefGoogle Scholar
Li, K.-C. (1986). Asymptotic optimality of CL and generalized cross-validation in ridge regression with application to spline smoothing. Annals of Statistics 14(3), 1101–1112.CrossRefGoogle Scholar
Liu, H. (2008). Generalized Additive Model. Department of Mathematics and Statistics, University of Minnesota Duluth, Duluth, MN 55812.Google Scholar
Reinsch, C. H. (1967). Smoothing by spline functions. Numerische Mathematik 10(3), 177–183.CrossRefGoogle Scholar
Schimek, M. G. (2000). Smoothing and Regression: Approaches, Computation, and Application. John Wiley & Sons, New York.CrossRefGoogle Scholar
Stone, M. (1977). Asymptotics for and against cross-validation. Biometrika 64(1), 29–35.CrossRefGoogle Scholar
Wahba, G. (1990). Spline Models for Observational Data. Number 59. Siam.
Wang, Y. (2011). Smoothing Splines: Methods and Applications. Taylor & Francis Group, New York.CrossRefGoogle Scholar
Wasserman, L. (2006). All of Nonparametric Statistics, Volume 4. Springer, New York.Google Scholar
Wood, S. (2006). Generalized Additive Models: An Introduction with R. Chapman & Hall, Boca Raton, FL.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×