Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-01-08T10:10:27.911Z Has data issue: false hasContentIssue false

Random Effects Diagonal Metric Multidimensional Scaling Models

Published online by Cambridge University Press:  01 January 2025

Douglas B. Clarkson*
Affiliation:
Data Analysis Products Division, MathSoft, Inc.
Richard Gonzalez
Affiliation:
University of Michigan
*
Requests for reprints should be sent to Douglas Clarkson, Dala Analysis Products Division, MathSoft, Inc., 1700 Westlake Ave. N., Suite 500, Seattle, WA, 98109-3044. E-Mail: [email protected]

Abstract

By assuming a distribution for the subject weights in a diagonal metric (INDSCAL) multidimensional scaling model, the subject weights become random effects. Including random effects in multidimensional scaling models offers several advantages over traditional diagonal metric models such as those fitted by the INDSCAL, ALSCAL, and other multidimensional scaling programs. Unlike traditional models, the number of parameters does not increase with the number of subjects, and, because the distribution of the subject weights is modeled, the construction of linear models of the subject weights and the testing of those models is immediate. Here we define a random effects diagonal metric multidimensional scaling model, give computational algorithms, describe our experiences with these algorithms, and provide an example illustrating the use of the model and algorithms.

Type
Articles
Copyright
Copyright © 2001 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We would like to thank J. Douglas Carroll for early consultation of this research, and Robert I. Jennrich for commenting on an earlier draft of this paper and for help on the computational algorithms. James O. Ramsay and Forrest W. Young were instrumental in providing the example data. This work was supported in part by National Institute of Mental Health grant 1 R43 MH57559-01. We would also like to thank the anonymous referees for comments that helped to clarify our work.

References

Aitkin, M. (1996). A general maximum likelihood analysis of overdispersion in generalized linear models. Statistics and Computing, 6, 251262.CrossRefGoogle Scholar
Aitkin, M., Aitkin, I. (1996). A hybrid EM/Gauss-Newton algorithm for maximum likelihood in mixture distributions. Statistics and Computing, 6, 127130.CrossRefGoogle Scholar
Bentler, P.M., Weeks, D.G. (1978). Restricted multidimennsional scaling models. Journal of Mathematical Psychology, 17, 138151.CrossRefGoogle Scholar
Bloxom, B. (1978). Constrained multidimensional scaling inN spaces. Psychometrika, 43, 397408.CrossRefGoogle Scholar
Carroll, J.D., Chang, J.J. (1970). Analysis of individual differences in multidimensional scaling via an n-way generalization of the “Eckart-Young” decomposition. Psychometrika, 35, 283319.CrossRefGoogle Scholar
Carroll, J.D., De Soete, G., Pruzansky, S. (1989). An evaluation of five algorithms for generating an initial estimate for SINDSCAL. Journal of Classification, 6, 105119.CrossRefGoogle Scholar
Carroll, J.D., Pruzansky, S., Kruskal, J.B. (1980). CANDELINC: A general approach to multidimensional analysis of many-way arrays with linear constraints on the parameters. Psychometrika, 45, 321.CrossRefGoogle Scholar
Clarkson, D.B., Gentle, J.E. (1986). Methods for multidimensional scaling. In David, M. Allen (Eds.), Proceedings of the 17th Symposium on the Interface (pp. 185192). Amsterdam: Elsevier.Google Scholar
Davidian, M., Giltinan, D. (1995). Nonlinear models for repeated measures data. New York: Chapman and Hall.Google Scholar
de Leeuw, J., Heiser, W.J. (1980). Multidimensional scaling with restrictions on the configuration. In Krishnaiah, P.R. (Eds.), Multivariate analysis (pp. 501522). Amsterdam, The Netherlands: North-Holland.Google Scholar
Demidenko, E. (1997). Asymptotic properties of nonlinear mixed effects models in large samples. In Gregoire, T.G., Brillinger, D.R., Diggle, P.J., Russek-Cohen, E., Warren, W.G., Wolfinger, R.D. (Eds.), Modelling longitudinal and spatially correlated data: Methods, applications, and future directions (pp. 4962). New York, NY: Springer-Verlag.CrossRefGoogle Scholar
DeSarbo, W.S., Howard, D.J., Jedidi, K. (1991). MULTICLUS: A new method for simultaneously performing multidimensional scaling and cluster analysis. Psychometrika, 78, 121136.CrossRefGoogle Scholar
DeSarbo, W.S., Rao, V.R. (1984). Genfold2: A set of models and algorithms for the general unfolding analysis of reference/dominance data. Journal of Classification, 1, 147186.CrossRefGoogle Scholar
Gay, D.M. (1983). Algorithm 611. Subroutines for unconstrained minimization using a model/trust-region approach. ACM Transactions on Mathematical Software, 9, 503524.CrossRefGoogle Scholar
Geyer, C.J. (1996). Estimation and optimization of functions. In Gilks, W.R., Richardson, S., Splegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in practice (pp. 241258). New York: Chapman and Hall.Google Scholar
Geyer, C.J., Thompson, E.A. (1992). Constrained Monte Carlo maximum likelihood for dependent data. Journal of the Royal Statistical Society, Series B, 54, 657699.CrossRefGoogle Scholar
Gilks, W.R., Richardson, S., Spiegelhalter, D. J. (1996). Introducing Marov Chain Monte Carlo. In Gilks, W.R., Richardson, S., Splegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in practice (pp. 119). New York: Chapman and Hall.Google Scholar
Jamshidian, M., Jennrich, R.I. (1993). Conjugate gradient acceleration of the EM algorithm. Journal of the American Statistical Association, 88, 221228.CrossRefGoogle Scholar
Jamshidian, M., & Jennrich, R.I. (1997). Acceleration of the EM algorithm using quasi-Newton methods. Manuscript submitted for publication.CrossRefGoogle Scholar
Laird, N.M. (1978). Nonparametric maximum likelihood estimates of a mixing distribution. Journal of the American Statistical Association, 73, 805811.CrossRefGoogle Scholar
Lindstrom, M.J., Bates, D.M. (1990). Nonlinear mixed effects models for repeated measures data. Biometrics, 46, 673687.CrossRefGoogle ScholarPubMed
Mallet, A. (1986). A maximum likelihood estimation method for random coefficient regression models. Biometrika, 73, 645656.CrossRefGoogle Scholar
McCulloch, C.E. (1997). Maximum likelihood algorithms for generalized linear models. Journal of the American Statistical Association, 92, 162170.CrossRefGoogle Scholar
McLachlan, G.J., Krishnan, T. (1997). The EM algorithm and extensions. New York: John Wiley & Sons.Google Scholar
Pinheiro, J.C., Bates, D.M. (1995). Mixed effects models, methods, and classes for S and S-Plus (Report No. 89). Madison, Wisconsin: University of Wisconsin, Madison.Google Scholar
Ramsay, J.O. (1982). Some statistical approaches to multidimensional scaling data. Journal of the Royal Statistical Society, Series B, 45, 285312.CrossRefGoogle Scholar
SAS Institute (1988). SAS language guide. Cary, North Carolina: Author.Google Scholar
Schiffman, S.S., Reynolds, M.L., Young, F.W. (1981). Introduction to multidimensional scaling: Theory, methods, and applications. New York: John Wiley and Sons.Google Scholar
Schumitzky, A. (1991). Nonparametric EM algorithms for estimating prior distributions. Applied Mathematics and Computations, 45, 143157.CrossRefGoogle Scholar
Sheiner, L.B., Rosenberg, B., Melmon, K.L. (1972). Modeling of individual pharmacokinetics for computer aided drug dosing. Computers and Biomedical Research, 5, 441459.CrossRefGoogle Scholar
StatSci, A Division of MathSoft (1993). S-Plus reference manual. Seattle, WA: Author.Google Scholar
Takane, Y., Young, F.W., de Leeuw, J. (1977). Nonmetric individual differences multidimensional scaling: An alternating least squares method with optimal scaling properties. Psychometrika, 42, 767.CrossRefGoogle Scholar
Tanner, M.A. (1996). Tools for statistical inference: Methods for the exploration of posterior distributions and likelihood functions. New York: Springer-Verlag.CrossRefGoogle Scholar
Vonesh, E.F., Chinchilli, V.M. (1997). Linear and nonlinear models for the analysis of repeated measurements. New York: Marcel Dekker.Google Scholar
Wedel, M., DeSarbo, W.S. (1996). An exponential-family multidimensional scaling mixture methodology. Journal of Business and Economic Statistics, 14, 447459.CrossRefGoogle Scholar
Wei, G.C.G., Tanner, M.A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithm. Journal of the American Statistical Association, 85, 699704.CrossRefGoogle Scholar
Winsberg, S., De Soete, G. (1993). A latent class approach to fitting the weighted Euclidean model, CLASCAL. Psychometrika, 58, 315330.CrossRefGoogle Scholar