Book contents
- Frontmatter
- Contents
- Contributors
- Cross-Cultural Research Methods in Psychology
- 1 Introduction to the Methodological Issues Associated With Cross-Cultural Research
- PART I Conceptual Issues and Design
- Part II Data Analysis and Interpretation
- 7 Methods for Investigating Structural Equivalence
- 8 Evaluating Test and Survey Items for Bias Across Languages and Cultures
- Appendix Statistical Software for Differential Item Functioning Analysis
- 9 Effect Sizes in Cross-Cultural Research
- 10 Data Analytic Approaches for Investigating Isomorphism Between the Individual-Level and the Cultural-Level Internal Structure
- 11 Multilevel Modeling and Cross-Cultural Research
- Appendix Sample Data Sets
- 12 Cross-Cultural Meta-Analysis
- Name index
- Subject index
- References
7 - Methods for Investigating Structural Equivalence
Published online by Cambridge University Press: 05 June 2012
Book contents
- Frontmatter
- Contents
- Contributors
- Cross-Cultural Research Methods in Psychology
- 1 Introduction to the Methodological Issues Associated With Cross-Cultural Research
- PART I Conceptual Issues and Design
- Part II Data Analysis and Interpretation
- 7 Methods for Investigating Structural Equivalence
- 8 Evaluating Test and Survey Items for Bias Across Languages and Cultures
- Appendix Statistical Software for Differential Item Functioning Analysis
- 9 Effect Sizes in Cross-Cultural Research
- 10 Data Analytic Approaches for Investigating Isomorphism Between the Individual-Level and the Cultural-Level Internal Structure
- 11 Multilevel Modeling and Cross-Cultural Research
- Appendix Sample Data Sets
- 12 Cross-Cultural Meta-Analysis
- Name index
- Subject index
- References
Summary
This chapter focuses on data analytic methods to investigate whether the internal structures of measurement instruments are equivalent between cultural groups. For example, is the structure of values that guide individuals’ lives similar between Western and Far Eastern countries? Do employees use the same dimensions to evaluate their organization and their supervisors in different cultural groups? Is the structure of personality between the United States and China the same, or are there culture-specific personality dimensions? This chapter introduces the four most commonly used data analytic methods to investigate the equivalence of the internal structure between cultural groups – namely, multidimensional scaling (MDS), principal component analysis (PCA), exploratory factor analysis (EFA), and confirmatory factor analysis. Before presenting these four data analytic methods, the concept of structural equivalence is explained and situated within the equivalence framework. Moreover, at the end of this chapter two general issues about sample size and data transformation before the analyses are discussed.
The concept of structural equivalence
The investigation of the internal structure forms a key element in the validation process of a measurement instrument within a cultural group (e.g., Messick, 1989). The question is whether the item responses adequately capture the underlying dimensions or factors of the domain one wants to assess. For instance, the responses to the items of a Big Five personality instrument should be captured by five underlying factors, and each of the items has to contribute to the assessment of the specific personality factor it has been constructed for. Thus, the investigation of the internal structure answers two questions: (a) what are the underlying dimensions or factors that capture the interrelationships between the observed item responses and (b) how does each item relate to these underlying dimensions or factors? The more the expected underlying dimensions emerge from the observed item–response relationships and the more each item relates to the expected underlying dimension, the more evidence there is for the construct validity of the instrument.
- Type
- Chapter
- Information
- Cross-Cultural Research Methods in Psychology , pp. 179 - 215Publisher: Cambridge University PressPrint publication year: 2010
References
1988 Structural equation modelling in practice: A review and recommended two-step approachPsychological Bulletin 103 411CrossRefGoogle Scholar
1997 Another consequence of culture – intra-cultural variationInternational Journal of Human Resource Management 8 743CrossRefGoogle Scholar
2005 http://www.pbarrett.net/orthosim2.htm
2007 Structural equation modeling: Adjudging model fitPersonality and Individual Differences: Special Issue on Structural Equation Modeling 42 815CrossRefGoogle Scholar
2010 Development of the Ghent Multidimensional Somatic Complaints ScaleAssessment 17 70CrossRefGoogle ScholarPubMed
1990 Comparative fit indexes in structural modelsPsychological Bulletin 107 238CrossRefGoogle ScholarPubMed
1980 Significance tests and goodness of fit in the analysis of covariance structuresPsychological Bulletin 88 588CrossRefGoogle Scholar
2002 Cross-cultural psychology:Research and applicationsCambridgeCambridge University PressGoogle Scholar
1988 The questionable value of cross-cultural comparisons with the Eysenck Personality QuestionnaireJournal of Cross-Cultural Psychology 19 193CrossRefGoogle Scholar
1986 On cross-cultural comparative studies with the Eysenck Personality QuestionnaireJournal of Cross-Cultural Psychology 17 3CrossRefGoogle Scholar
2010
2006 Emotion without a word: Shame and guilt among Rarámuri Indians and rural JavaneseJournal of Personality and Social Psychology 91 1111CrossRefGoogle ScholarPubMed
1992 Alternative ways of assessing model fitSociological Methods and Research 21 230CrossRefGoogle Scholar
1989 Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariancePsychological Bulletin 105 456CrossRefGoogle Scholar
2000 Multivariate methods for the comparison of factor structures in cross-cultural research: An illustration with the Big Five QuestionnaireJournal of Cross-Cultural Psychology 31 437CrossRefGoogle Scholar
1999 An alternative method for evaluating congruence coefficients with Procrustes rotationPsychological Methods 4 378CrossRefGoogle Scholar
2000 Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modelingJournal of Cross-Cultural Psychology 31 160CrossRefGoogle Scholar
1991 Matching configurationsLeiden, the NetherlandsDSWO Presshttp://three-mode.leidenuniv.nl/bibliogr/commandeurjjf_thesis/front.pdfGoogle Scholar
1989 Analysis of correlation matrices using covariance structure modelPsychological Bulletin 705 317CrossRefGoogle Scholar
1986 Cross-cultural comparisons: The validity of assessment by indices of factor comparisonJournal of Cross-Cultural Psychology 17 506CrossRefGoogle Scholar
2004 Organizational reward allocation principles: Testing organizational and cross-cultural differencesInternational Journal for Intercultural Relations 28 151CrossRefGoogle Scholar
2004 Standardization to account for cross-cultural response bias: A classification of score adjustment procedures and review of research in Journal of Cross-Cultural Psychology 35 263CrossRefGoogle Scholar
2008 Organizational justice and reward allocationHandbook of cross-cultural management135Thousand Oaks, CASageCrossRefGoogle Scholar
2009 Individualism–collectivism as descriptive norms: Development of a subjective norm approach to culture measurementJournal of Cross-Cultural Psychology 40 187CrossRefGoogle Scholar
2003 Reward allocation and culture: A meta-analysisJournal of Cross-Cultural Psychology 34 251CrossRefGoogle Scholar
2006 Justice criteria in the work place: The importance of values for perceptions of justiceApplied Psychology: International Review 55 541CrossRefGoogle Scholar
2007 Organizational reward allocation principles: Testing organizational and cross-cultural differencesJournal of Cross-Cultural Psychology 38 1Google Scholar
2008 Traditional and multilevel approaches in cross-cultural research: An integration of methodological frameworksIndividuals and cultures in multi-level analysis65Mahwah, NJErlbaumGoogle Scholar
2006 Untying the Gordian knot of guilt and shame: The structure of guilt and shame reactions based on situation and person variation in Belgium, Hungary, and PeruJournal of Cross-Cultural Psychology 37 273CrossRefGoogle Scholar
2008 Structural equivalence of the values domain across cultures: Distinguishing sampling fluctuations from meaningful variationJournal of Cross-Cultural Psychology 39 345CrossRefGoogle Scholar
2002 Cognitive structure of emotion terms in Indonesia and The NetherlandsCognition and Emotion 16 61CrossRefGoogle Scholar
1996 Personal initiative at work: Differences between East and West GermanyAcademy of Management Journal 39 37Google Scholar
1998 Silence in Japan and the United StatesJournal of Cross-Cultural Psychology 29 668CrossRefGoogle Scholar
1970 Some properties of ipsative, normative and forced-choice normative measuresPsychological Bulletin 74 167CrossRefGoogle Scholar
1996 Filial piety and its psychological consequencesHandbook of Chinese psychology155Hong KongOxford University PressGoogle Scholar
1980 Culture's consequences: International differences in work-related valuesBeverly Hills, CASageGoogle Scholar
1998 Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecificationPsychological Methods 3 424CrossRefGoogle Scholar
1999 Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling 6 1CrossRefGoogle Scholar
1990 SCA: A program for simultaneous components analysis of variables measured in two or more populationsthe NetherlandsProGAMMAGoogle Scholar
1989 Alternating least squares algorithms for simultaneous component analysis with equal weight matrices in two or more populationsPsychometrica 54 467CrossRefGoogle Scholar
2005 How generalizable are justice effects across cultures?Handbook of organizational justice555Mahwah, NJErlbaumGoogle Scholar
1997 Negotiation and reward allocation across culturesNew perspectives on international industrial/organizational psychology640San FranciscoNew LexingtonGoogle Scholar
1989 On the empirical identification of dimensions for cross-cultural comparisonsJournal of Cross-Cultural Psychology 20 133CrossRefGoogle Scholar
1997 Mean and covariance structures (MACS) analysis of cross-cultural data: Practical and theoretical issuesMultivariate Behavioral Research 32 53CrossRefGoogle Scholar
2007 Representing contextual effects in multiple-group MACS modelsModeling contextual effects in longitudinal studies121Mahwah, NJErlbaumGoogle Scholar
2000 Applications of structural equation modelling in psychological researchAnnual Review of Psychology 51 201CrossRefGoogle Scholar
1988 Goodness of fit indexes in confirmatory factor analysis: The effect of sample sizePsychological Bulletin 103 391CrossRefGoogle Scholar
2004 In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indexes and dangers in overgeneralising Hu & Bentler (1999) findingsStructural Equation Modeling 11 320CrossRefGoogle Scholar
1996 Evaluating replicability of factors in the Revised NEO Personality Inventory: Confirmatory factor analysis versus Procrustes rotationJournal of Personality and Social Psychology 70 552CrossRefGoogle Scholar
1993 Measurement invariance, factor analysis and factorial invariancePsychometrika 58 525CrossRefGoogle Scholar
1999 On the bipolarity of positive and negative affectPsychological Bulletin 125 3CrossRefGoogle ScholarPubMed
1992 Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countriesAdvances in Experimental Social Psychology 25 1CrossRefGoogle Scholar
2008 Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approachesIndividuals and cultures in multilevel analysis93Mahwah, NJErlbaumGoogle Scholar
1992 Cross-cultural similarities and differences in emotion and its representation: A prototype approachReview of personality and social psychology: Vol. 13. Emotion175Newbury Park, CASageGoogle Scholar
1999 Unpackaging cultures's influence on self-esteem and embarrassabilityJournal of Cross-Cultural Psychology 30 315CrossRefGoogle Scholar
1986 Some relationships between descriptive comparisons of components from different studiesMultivariate Behavioral Research 21 29CrossRefGoogle ScholarPubMed
2000 A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational researchOrganizational Research Methods 3 4CrossRefGoogle Scholar
1999 The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidenceJournal of Personality and Social Psychology 76 820CrossRefGoogle Scholar
2003 Adjustment for acquiescence in the assessment of the construct equivalence of Likert-type score itemsJournal of Cross-Cultural Psychology 34 702CrossRefGoogle Scholar
1995 Personality correlates of allocentric tendencies in individualist and collectivist culturesJournal of Cross-Cultural Psychology 26 658CrossRefGoogle Scholar
- 18
- Cited by