Hostname: page-component-599cfd5f84-9drbd Total loading time: 0 Render date: 2025-01-07T08:41:32.361Z Has data issue: false hasContentIssue false
  • English
  • Français

A Simple Gauss-Newton Procedure for Covariance Structure Analysis with High-Level Computer Languages

Published online by Cambridge University Press:  01 January 2025

Robert Cudeck ,
Kelli J. Klebe  and
Susan J. Henly
Robert Cudeck*
Affiliation:
University of Minnesota
Kelli J. Klebe
Affiliation:
University of Colorado, Colorado Springs
Susan J. Henly
Affiliation:
College of Nursing, University of North Dakota
*
Requests for reprints should be sent to Robert Cudeck, Department of Psychology, University of Minnesota, 75 East River Road, Minneapolis, MN 55455.
Get access Rights & Permissions [Opens in a new window]

Abstract

An implementation of the Gauss-Newton algorithm for the analysis of covariance structures that is specifically adapted for high-level computer languages is reviewed. With this procedure one need only describe the structural form of the population covariance matrix, and provide a sample covariance matrix and initial values for the parameters. The gradient and approximate Hessian, which vary from model to model, are computed numerically. Using this approach, the entire method can be operationalized in a comparatively small program. A large class of models can be estimated, including many that utilize functional relationships among the parameters that are not possible in most available computer programs. Some examples are provided to illustrate how the algorithm can be used.

Keywords

covariance structuresGauss-Newton methodsimplex modelssecond order factor analysisdichotomized variables
Type
Original Paper
Information
Psychometrika , Volume 58 , Issue 2 , June 1993 , pp. 211 - 232
Copyright
Copyright © 1993 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We are grateful to M. W. Browne and S. H. C. du Toit for many invaluable discussions about these computing ideas. Thanks also to Scott Chaiken for providing the data in the first example. They were collected as part of the U.S. Air Force's Learning Ability Measurement Project (LAMP), sponsored by the Air Force Office of Scientific Research (AFOSR) and the Human Resource Directorate of the Armstrong Laboratory (AL/HRM).

References

Anderson, T. W. (1960). Some stochastic process models for intelligence test scores. In Arrow, K. J., Karlin, S., Suppes, P. (Eds.), Mathematical methods in the social sciences (pp. 205–220). Stanford, CA: Stanford University Press.Google Scholar
Bentler, P. M., Lee, S.-L. (1983). Covariance structures under polynomial constraints: Applications to correlation and alpha-type structural models. Journal of Educational Statistics, 8, 207–222.CrossRefGoogle Scholar
Bock, R. D., Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179–197.CrossRefGoogle Scholar
Bollen, K. A. (1989). Structural equations with latent variables, New York: Wiley.CrossRefGoogle Scholar
Browne, M. W. (1982). Covariance structures. In Hawkins, D. M. (Eds.), Topics in applied multivariate analysis (pp. 72–141). Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62–83.CrossRefGoogle ScholarPubMed
Browne, M. W., du Toit, S. H. C. (1992). Automated fitting of nonstandard models. Multivariate Behavioral Research, 27, 269–300.CrossRefGoogle ScholarPubMed
Burden, R. L., Faires, J. D. (1989). Numerical analysis 4th ed.,, Boston: Prindle, Weber & Schmidt.Google Scholar
Christoffersson, A. (1975). Factor analysis of dichotomized variables. Psychometrika, 40, 5–32.CrossRefGoogle Scholar
Fraser, C. (1979). COSAN: User's guide, Toronto: Ontario Institute for Studies in Education, Department of Measurement, Evaluation and Computer Applications.Google Scholar
Foremel, E. A. (1971). A comparison of computer routines for the calculation of the tetrachoric correlation coefficient. Psychometrika, 36, 165–173.CrossRefGoogle Scholar
Green, D. P., Palmquist, B. L. (1991). More “tricks of the trade”: Reparameterizing LISREL models using negative variances. Psychometrika, 56, 137–145.CrossRefGoogle Scholar
Humphreys, L. G. (1968). The fleeting nature of the prediction of college academic success. Journal of Educational Psychology, 59, 375–380.CrossRefGoogle ScholarPubMed
Jennrich, R. I., Sampson, P. F. (1966). Application of stepwise regression to nonlinear estimation. Technometrics, 10, 63–72.CrossRefGoogle Scholar
Jöreskog, K. G. (1970). Estimation and testing of simplex models. British Journal of Mathematical and Statistical Psychology, 23, 121–145.CrossRefGoogle Scholar
Jöreskog, K. G. (1981). Analysis of covariance structures. Scandinavian Journal of Statistics, 8, 65–92.Google Scholar
Jöreskog, K. G., Sörbom, D. (1989). LISREL 7 user's guide, Mooresville, IN: Scientific Software.Google Scholar
Lee, S.-Y., Jennrich, R. I. (1979). A study of algorithms for covariance structure analysis with specific comparisons using factor analysis. Psychometrika, 44, 99–113.CrossRefGoogle Scholar
Lee, S.-Y., Jennrich, R. I. (1984). The analysis of structural equation models by means of derivative free nonlinear least squares. Psychometrika, 49, 521–528.CrossRefGoogle Scholar
Long, J. S. (1990). [Review of software for structural equation modeling: EQS, EQS-EM, EzPATH, LISCOMP, LISREL 7]. Journal of Marketing Research, 37, 372–378.Google Scholar
McDonald, R. P. (1967). Nonlinear factor analysis. Psychometric Monograph Number 15, 32 (4, Pt. 2).Google Scholar
McDonald, R. P. (1978). A simple comprehensive model for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 31, 59–72.CrossRefGoogle Scholar
McDonald, R. P. (1985). Unidimensional and multidimensional models for item response theory. In Weiss, D. J. (Eds.), Proceedings of the 1982 item response theory and computerized adaptive testing conference (pp. 127–148). Minneapolis, MN: University of Minnesota, Department of Psychology.Google Scholar
Mooijaart, A. (1983). Two kinds of factor analysis for ordered categorical variables. Multivariate Behavioral Research, 18, 423–441.CrossRefGoogle ScholarPubMed
Morrison, D. F. (1990). Multivariate statistical methods 3rd ed.,, New York: McGraw-Hill.Google Scholar
Muthén, B. (1978). Contributions to factor analysis of dichotomous variables. Psychometrika, 43, 551–560.CrossRefGoogle Scholar
Pickle, L. W. (1991). Maximum likelihood estimation in the new computing environment. Statistical Computing and Statistical Graphical Newsletter, 3, 6–15.Google Scholar
Rindskopf, D. (1983). Parameterizing inequality constraints on unique variances in linear structural models. Psychometrika, 48, 73–83.CrossRefGoogle Scholar
Rindskopf, D. (1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49, 37–47.CrossRefGoogle Scholar
Rindskopf, D., Rose, T. (1988). Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research, 23, 51–67.CrossRefGoogle Scholar
SAS Institute (1985). SAS/IML user's guide, version 5, Cary, NC: Author.Google Scholar
Sörbom, D. (1975). Detection of correlated errors in longitudinal data. British Journal of Mathematical and Statistical Psychology, 28, 138–151.CrossRefGoogle Scholar
Swain, A. J. (1975). A class of factor analysis estimation procedures with common asymptotic sampling properties. Psychometrika, 40, 315–335.CrossRefGoogle Scholar
Takane, Y., de Leeuw, J. (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52, 393–408.CrossRefGoogle Scholar
Thisted, R. A. (1988). Elements of statistical computing, New York: Chapman and Hall.Google Scholar
Werts, C., Linn, R. L., Jöreskog, K. G. (1978). Reliability of college grades from longitudinal data. Educational and Psychological Measurement, 38, 89–95.CrossRefGoogle Scholar
Wheaton, B., Muthén, B., Alwin, D., Summers, G. (1977). Assessing reliability and stability in panel models. In Heise, D. R. (Eds.), Sociological methodology (pp. 84–136). San Francisco: Jossey-Bass.Google Scholar
Wiley, J. A., Wiley, M. G. (1974). A note on correlated errors in repeated measurements. Sociological Methods and Research, 3, 172–188.CrossRefGoogle Scholar
Woltz, D. J. (1988). An investigation of the role of working memory in procedural skill acquisition. Journal of Experimental Psychology: General, 117, 319–331.CrossRefGoogle Scholar
Wothke, W., Browne, M. W. (1990). The direct product model for the MTMM matrix parameterized as a second order factor analysis model. Psychometrika, 55, 255–262.CrossRefGoogle Scholar