Skip to main content Accessibility help
×
Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-22T21:13:58.103Z Has data issue: false hasContentIssue false

7 - Methods for Investigating Structural Equivalence

Published online by Cambridge University Press:  05 June 2012

David Matsumoto
Affiliation:
San Francisco State University
Fons J. R. van de Vijver
Affiliation:
Universiteit van Tilburg, The Netherlands
Get access

Summary

This chapter focuses on data analytic methods to investigate whether the internal structures of measurement instruments are equivalent between cultural groups. For example, is the structure of values that guide individuals’ lives similar between Western and Far Eastern countries? Do employees use the same dimensions to evaluate their organization and their supervisors in different cultural groups? Is the structure of personality between the United States and China the same, or are there culture-specific personality dimensions? This chapter introduces the four most commonly used data analytic methods to investigate the equivalence of the internal structure between cultural groups – namely, multidimensional scaling (MDS), principal component analysis (PCA), exploratory factor analysis (EFA), and confirmatory factor analysis. Before presenting these four data analytic methods, the concept of structural equivalence is explained and situated within the equivalence framework. Moreover, at the end of this chapter two general issues about sample size and data transformation before the analyses are discussed.

The concept of structural equivalence

The investigation of the internal structure forms a key element in the validation process of a measurement instrument within a cultural group (e.g., Messick, 1989). The question is whether the item responses adequately capture the underlying dimensions or factors of the domain one wants to assess. For instance, the responses to the items of a Big Five personality instrument should be captured by five underlying factors, and each of the items has to contribute to the assessment of the specific personality factor it has been constructed for. Thus, the investigation of the internal structure answers two questions: (a) what are the underlying dimensions or factors that capture the interrelationships between the observed item responses and (b) how does each item relate to these underlying dimensions or factors? The more the expected underlying dimensions emerge from the observed item–response relationships and the more each item relates to the expected underlying dimension, the more evidence there is for the construct validity of the instrument.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anderson, J. C.Gerbig, D. W. 1988 Structural equation modelling in practice: A review and recommended two-step approachPsychological Bulletin 103 411CrossRefGoogle Scholar
Au, K. Y. 1997 Another consequence of culture – intra-cultural variationInternational Journal of Human Resource Management 8 743CrossRefGoogle Scholar
Barrett, P. 2005 http://www.pbarrett.net/orthosim2.htm
Barrett, P. 2007 Structural equation modeling: Adjudging model fitPersonality and Individual Differences: Special Issue on Structural Equation Modeling 42 815CrossRefGoogle Scholar
Beirens, K.Fontaine, J. R. J. 2010 Development of the Ghent Multidimensional Somatic Complaints ScaleAssessment 17 70CrossRefGoogle ScholarPubMed
Bentler, P. M. 1990 Comparative fit indexes in structural modelsPsychological Bulletin 107 238CrossRefGoogle ScholarPubMed
Bentler, P. M.Bonnett, D. G. 1980 Significance tests and goodness of fit in the analysis of covariance structuresPsychological Bulletin 88 588CrossRefGoogle Scholar
Berry, J. W.Poortinga, J. H.Segall, M. H.Dasen, P. R. 2002 Cross-cultural psychology:Research and applicationsCambridgeCambridge University PressGoogle Scholar
Bijnen, E. J.Poortinga, Y. H. 1988 The questionable value of cross-cultural comparisons with the Eysenck Personality QuestionnaireJournal of Cross-Cultural Psychology 19 193CrossRefGoogle Scholar
Bijnen, E. J.Van Der Net, T. Z. J.Poortinga, Y. H. 1986 On cross-cultural comparative studies with the Eysenck Personality QuestionnaireJournal of Cross-Cultural Psychology 17 3CrossRefGoogle Scholar
Bilsky, W.Janik, M.Schwartz, S. H. 2010
Bollen, K. A. 1989 Structural equations with latent variablesNew YorkWileyCrossRefGoogle Scholar
Borg, I.Groenen, P. 2005 Modern multidimensional scaling: Theory and applicationsNew YorkSpringerGoogle Scholar
Borsboom, D. 2006 The attack of the psychometriciansPsychometrika 71 425CrossRefGoogle ScholarPubMed
Breugelmans, S. M.Poortinga, Y. H. 2006 Emotion without a word: Shame and guilt among Rarámuri Indians and rural JavaneseJournal of Personality and Social Psychology 91 1111CrossRefGoogle ScholarPubMed
Browne, M. W.Cudeck, R. 1992 Alternative ways of assessing model fitSociological Methods and Research 21 230CrossRefGoogle Scholar
Byrne, B. M.Shavelson, R. J.Muthén, B. 1989 Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariancePsychological Bulletin 105 456CrossRefGoogle Scholar
Caprara, G. V.Barbaranelli, C.Bermúndez, J.Maslach, C.Ruch, W. 2000 Multivariate methods for the comparison of factor structures in cross-cultural research: An illustration with the Big Five QuestionnaireJournal of Cross-Cultural Psychology 31 437CrossRefGoogle Scholar
Chan, W. 2003 Analyzing ipsative data in psychological researchBehaviormetrika 30 99CrossRefGoogle Scholar
Chan, W.Ho, R.Leung, K.Chan, D. K.Yung, F. 1999 An alternative method for evaluating congruence coefficients with Procrustes rotationPsychological Methods 4 378CrossRefGoogle Scholar
Cheung, G. W.Rensvold, R. B. 2000 Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modelingJournal of Cross-Cultural Psychology 31 160CrossRefGoogle Scholar
Commandeur, J. J. F. 1991 Matching configurationsLeiden, the NetherlandsDSWO Presshttp://three-mode.leidenuniv.nl/bibliogr/commandeurjjf_thesis/front.pdfGoogle Scholar
Cudeck, R. 1989 Analysis of correlation matrices using covariance structure modelPsychological Bulletin 705 317CrossRefGoogle Scholar
Eysenck, H. J. 1986 Cross-cultural comparisons: The validity of assessment by indices of factor comparisonJournal of Cross-Cultural Psychology 17 506CrossRefGoogle Scholar
Field, A. 2009 Discovering statistics using SPSSThousand Oaks, CASageGoogle Scholar
Fischer, R. 2004 Organizational reward allocation principles: Testing organizational and cross-cultural differencesInternational Journal for Intercultural Relations 28 151CrossRefGoogle Scholar
Fischer, R. 2004 Standardization to account for cross-cultural response bias: A classification of score adjustment procedures and review of research in Journal of Cross-Cultural Psychology 35 263CrossRefGoogle Scholar
Fischer, R. 2008 Organizational justice and reward allocationSmith, P. B.Peterson, M.Thomas, D.Handbook of cross-cultural management135Thousand Oaks, CASageCrossRefGoogle Scholar
Fischer, R.Ferreira, M. C.Assmar, E.Redford, P.Harb, C.Glazer, S. 2009 Individualism–collectivism as descriptive norms: Development of a subjective norm approach to culture measurementJournal of Cross-Cultural Psychology 40 187CrossRefGoogle Scholar
Fischer, R.Milfont, T.Gouveia, V. V.
Fischer, R.Smith, P. B. 2003 Reward allocation and culture: A meta-analysisJournal of Cross-Cultural Psychology 34 251CrossRefGoogle Scholar
Fischer, R.Smith, P. B. 2006 Justice criteria in the work place: The importance of values for perceptions of justiceApplied Psychology: International Review 55 541CrossRefGoogle Scholar
Fischer, R.Smith, P. B.Richey, B. E.Ferreira, M. C.Assmar, E. M. L.Maes, J.Stumpf, S. 2007 Organizational reward allocation principles: Testing organizational and cross-cultural differencesJournal of Cross-Cultural Psychology 38 1Google Scholar
Fontaine, J. R. J. 2003 Multidimensional scalingHarkness, J.van de Vijver, F. J. R.Mohler, P. Ph.Cross-cultural survey methods235Hoboken, NJWileyGoogle Scholar
Fontaine, J. R. J. 2005 EquivalenceKempf-Leonard, K.Encyclopedia of social measurement803New YorkAcademic PressCrossRefGoogle Scholar
Fontaine, J. R. J. 2008 Traditional and multilevel approaches in cross-cultural research: An integration of methodological frameworksvan de Vijver, F. J. R.van Hemert, D. A.Poortinga, Y.Individuals and cultures in multi-level analysis65Mahwah, NJErlbaumGoogle Scholar
Fontaine, J. R. J.Luyten, P.De Boeck, P.Corveleyn, J.Fernandez, M.Herrera, D. 2006 Untying the Gordian knot of guilt and shame: The structure of guilt and shame reactions based on situation and person variation in Belgium, Hungary, and PeruJournal of Cross-Cultural Psychology 37 273CrossRefGoogle Scholar
Fontaine, J. R. J.Poortinga, Y. H.Delbeke, L.Schwartz, S. H. 2008 Structural equivalence of the values domain across cultures: Distinguishing sampling fluctuations from meaningful variationJournal of Cross-Cultural Psychology 39 345CrossRefGoogle Scholar
Fontaine, J. R. J.Poortinga, Y. H.Setiadi, B.Suprapti, S. M. 2002 Cognitive structure of emotion terms in Indonesia and The NetherlandsCognition and Emotion 16 61CrossRefGoogle Scholar
Frese, M.Kring, W.Soose, A.Zempel, J. 1996 Personal initiative at work: Differences between East and West GermanyAcademy of Management Journal 39 37Google Scholar
Hasegawa, T.Gudykunst, W. B. 1998 Silence in Japan and the United StatesJournal of Cross-Cultural Psychology 29 668CrossRefGoogle Scholar
Hicks, L.E. 1970 Some properties of ipsative, normative and forced-choice normative measuresPsychological Bulletin 74 167CrossRefGoogle Scholar
Ho, D. Y. F. 1996 Filial piety and its psychological consequencesBond, M. H.Handbook of Chinese psychology155Hong KongOxford University PressGoogle Scholar
Hofstede, G. 1980 Culture's consequences: International differences in work-related valuesBeverly Hills, CASageGoogle Scholar
Hu, L. T.Bentler, P. M. 1998 Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecificationPsychological Methods 3 424CrossRefGoogle Scholar
Hu, L.Bentler, P. M. 1999 Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling 6 1CrossRefGoogle Scholar
Kline, R. B. 2005 Principles and practice of structural equation modelingNew YorkGuilford PressGoogle Scholar
Kiers, H. A. L. 1990 SCA: A program for simultaneous components analysis of variables measured in two or more populationsthe NetherlandsProGAMMAGoogle Scholar
Kiers, H. A. L.Ten Berge, J. M. F. 1989 Alternating least squares algorithms for simultaneous component analysis with equal weight matrices in two or more populationsPsychometrica 54 467CrossRefGoogle Scholar
Kruskal, J. B.Wish, M. 1978 Multidimensional scalingLondonSageCrossRefGoogle Scholar
Leung, K. 2005 How generalizable are justice effects across cultures?Greenberg, J.Colquitt, J. A.Handbook of organizational justice555Mahwah, NJErlbaumGoogle Scholar
Leung, K. 1997 Negotiation and reward allocation across culturesEarley, P. C.Erez, M.New perspectives on international industrial/organizational psychology640San FranciscoNew LexingtonGoogle Scholar
Leung, K.Bond, M. H. 1989 On the empirical identification of dimensions for cross-cultural comparisonsJournal of Cross-Cultural Psychology 20 133CrossRefGoogle Scholar
Little, T. D. 1997 Mean and covariance structures (MACS) analysis of cross-cultural data: Practical and theoretical issuesMultivariate Behavioral Research 32 53CrossRefGoogle Scholar
Little, T. D.Card, N. A.Slegers, D. W.Ledford, E. C. 2007 Representing contextual effects in multiple-group MACS modelsLittle, T. D.Bovaird, J. A.Card, N. A.Modeling contextual effects in longitudinal studies121Mahwah, NJErlbaumGoogle Scholar
Long, J.S. 1983 Confirmatory factor analysisNewbury Park, CASageCrossRefGoogle Scholar
MacCallum, R. C.Austin, J. T. 2000 Applications of structural equation modelling in psychological researchAnnual Review of Psychology 51 201CrossRefGoogle Scholar
Marsh, H. W.Balla, J. R.McDonald, R. P. 1988 Goodness of fit indexes in confirmatory factor analysis: The effect of sample sizePsychological Bulletin 103 391CrossRefGoogle Scholar
Marsh, H. W.Hau, K. T.Wen, Z. L. 2004 In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralising Hu & Bentler (1999) findingsStructural Equation Modeling 11 320CrossRefGoogle Scholar
McCrae, R. R.Zonderman, A. B.Costa, P. T.Bond, M. H.Paunonen, S. V. 1996 Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotationJournal of Personality and Social Psychology 70 552CrossRefGoogle Scholar
Meredith, W. 1993 Measurement invariance, factor analysis and factorial invariancePsychometrika 58 525CrossRefGoogle Scholar
Messick, S. 1989 ValidityLinn, R. L.Educational measurement13New YorkMacmillan Publishing CompanyGoogle Scholar
Russell, J. A.Carroll, J. M. 1999 On the bipolarity of positive and negative affectPsychological Bulletin 125 3CrossRefGoogle ScholarPubMed
Schwartz, S. H. 1992 Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countriesAdvances in Experimental Social Psychology 25 1CrossRefGoogle Scholar
Selig, J. P.Card, N. A.Little, T. D. 2008 Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approachesvan de Vijver, F. J. R.van Hemert, D. A.Poortinga, Y. H.Individuals and cultures in multilevel analysis93Mahwah, NJErlbaumGoogle Scholar
Shaver, P. R.Wu, S.Schwartz, J. C. 1992 Cross-cultural similarities and differences in emotion and its representation: A prototype approachClark, M. S.Review of personality and social psychology: Vol. 13. Emotion175Newbury Park, CASageGoogle Scholar
Singelis, T. M.Bond, M. H.Sharkey, W. F.Lai, C.S.Y. 1999 Unpackaging cultures's influence on self-esteem and embarrassabilityJournal of Cross-Cultural Psychology 30 315CrossRefGoogle Scholar
Tabachnick, B. G.Fidell, L. S. 2007 Using multivariate statisticsBostonAllyn & BaconGoogle Scholar
Ten Berge, J. M. F. 1986 Some relationships between descriptive comparisons of components from different studiesMultivariate Behavioral Research 21 29CrossRefGoogle ScholarPubMed
Triandis, H. C. 1995 Individualism & collectivismBoulder, COWestview PressGoogle Scholar
Ullman, J. B. 2007 Structural equation modelingTabachnick, B. G.Fidell, L.Using multivariate statistics676BostonAllyn & BaconGoogle Scholar
Van de Vijver, F. J. R.Leung, K. 1997 Methods and data analysis for cross-cultural researchLondonSageGoogle Scholar
Vandenberg, R. J.Lance, C. E. 2000 A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational researchOrganizational Research Methods 3 4CrossRefGoogle Scholar
Watson, D.Wiese, D.Vaidya, J.Tellegen, A. 1999 The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidenceJournal of Personality and Social Psychology 76 820CrossRefGoogle Scholar
Welkenhuysen-Gybels, J.Billiet, J.Cambre, B. 2003 Adjustment for acquiescence in the assessment of the construct equivalence of Likert-type score itemsJournal of Cross-Cultural Psychology 34 702CrossRefGoogle Scholar
Yamaguchi, S.Kuhlman, D. M.Sugimori, S. 1995 Personality correlates of allocentric tendencies in individualist and collectivist culturesJournal of Cross-Cultural Psychology 26 658CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×