Book contents
- Frontmatter
- Contents
- Contributors
- Cross-Cultural Research Methods in Psychology
- 1 Introduction to the Methodological Issues Associated With Cross-Cultural Research
- PART I Conceptual Issues and Design
- 2 Equivalence and Bias: A Review of Concepts, Models, and Data Analytic Procedures
- 3 Translating and Adapting Tests for Cross-Cultural Assessments
- Appendix Item Translation and Adaptation Review Form
- 4 Making Scientific Sense of Cultural Differences in Psychological Outcomes: Unpackaging the Magnum Mysterium
- 5 Sampling: The Selection of Cases for Culturally Comparative Psychological Research
- 6 Survey Response Styles Across Cultures
- Part II Data Analysis and Interpretation
- Name index
- Subject index
- References
2 - Equivalence and Bias: A Review of Concepts, Models, and Data Analytic Procedures
Published online by Cambridge University Press: 05 June 2012
Book contents
- Frontmatter
- Contents
- Contributors
- Cross-Cultural Research Methods in Psychology
- 1 Introduction to the Methodological Issues Associated With Cross-Cultural Research
- PART I Conceptual Issues and Design
- 2 Equivalence and Bias: A Review of Concepts, Models, and Data Analytic Procedures
- 3 Translating and Adapting Tests for Cross-Cultural Assessments
- Appendix Item Translation and Adaptation Review Form
- 4 Making Scientific Sense of Cultural Differences in Psychological Outcomes: Unpackaging the Magnum Mysterium
- 5 Sampling: The Selection of Cases for Culturally Comparative Psychological Research
- 6 Survey Response Styles Across Cultures
- Part II Data Analysis and Interpretation
- Name index
- Subject index
- References
Summary
Introduction
This chapter addresses the methodological issues associated with equivalence and bias in cross-cultural research. These issues are a consequence of the nonexperimental nature of the research designs of cross-cultural studies. True experiments are based on the random assignment of participants to different experimental conditions, which presumably ensures that confounding variables are equated across experimental conditions. However, participants cannot be randomly assigned to cultures, and groups that are compared in cross-cultural studies can hardly ever be seen as matched on all background variables that are relevant for the constructs of interest. Cross-cultural psychology is not unique in the impossibility of matching groups; many studies in clinical and educational psychology involve situations in which intact groups are studied, and the assumption of the similarity of background characteristics across groups is unrealistic. The inability to conduct true experiments to address essential questions in cross-cultural psychology implies that we have to be careful in conducting our studies, being cognizant of relevant methodological knowledge and tools. It also implies that cross-cultural studies are always threatened by bias and inequivalence when cultural groups are being compared.
This chapter reviews the extant knowledge of these methodological issues. Our main message is that maximizing the validity of inferences should be the main concern of cross-cultural research and that methodological rigor in terms of establishing cross-cultural equivalence and suppressing bias across cultures plays a crucial role in this endeavor. We first describe a taxonomy of equivalence and bias, how they can be assessed, and the measures that can be taken to increase the validity of cross-cultural inferences. The second part gives an overview of procedures for adapting tests and survey questionnaires across cultures. Conclusions are presented in the final section.
- Type
- Chapter
- Information
- Cross-Cultural Research Methods in Psychology , pp. 17 - 45Publisher: Cambridge University PressPrint publication year: 2010
References
1994 Interviewer mode effects in surveys of drug and alcohol usePublic Opinion Quarterly 58 210CrossRefGoogle Scholar
2000 Mental illness and its treatment in MalaysiaAl-Junun: Mental illness in the Islamic world163Madison, CTInternational Universities PressGoogle Scholar
1987 Descriptors for an intelligent person: A Japanese studyJapanese Psychological Research 29 17CrossRefGoogle Scholar
1975 Word length and the structure of short-term memoryJournal of Verbal Learning and Verbal Behavior 14 575CrossRefGoogle Scholar
1998 The Eysenck Personality Questionnaire: An examination of the factorial similarity of P, E, N, and L across 34 countriesPersonality and Individual Differences 25 805CrossRefGoogle Scholar
1980 Translation and content analysis of oral and written materialsHandbook of cross-cultural psychology389BostonAllyn and BaconGoogle Scholar
1987 Politeness: Some universals in language usageNew YorkCambridge University PressCrossRefGoogle Scholar
1986 Science's social system of validity-enhancing collective belief change and the problems of the social sciencesMetatheory in social science108ChicagoUniversity of Chicago PressGoogle Scholar
1999 An alternative method for evaluating congruence coefficients with Procrustes rotation: A bootstrap procedurePsychological Methods 4 378CrossRefGoogle Scholar
2006 Evaluating multilevel models in cross-cultural research: An illustration with social axiomsJournal of Cross-Cultural Psychology 37 522CrossRefGoogle Scholar
2001 Mode effects in self-reported mental health dataPublic Opinion Quarterly 65 529CrossRefGoogle Scholar
2008 A comparison of normative data for the Trail Making Test from several countries: Equivalence of norms and considerations for interpretationScandinavian Journal of Psychology 49 239CrossRefGoogle ScholarPubMed
2004 Utility of the Mantel–Haenszel procedure for detecting differential item functioning in small samplesEducational and Psychological Measurement 64 925CrossRefGoogle Scholar
2007 Empirical Bayes versus standard Mantel–Haenszel statistics for detecting differential item functioning under small sample conditionsJournal of Experimental Education 75 293CrossRefGoogle Scholar
2008 Structural equivalence of the values domain across cultures: Distinguishing sampling fluctuations from meaningful variationJournal of Cross-Cultural Psychology 39 345CrossRefGoogle Scholar
1979 Wiener Matrizen-Test. Ein Rasch-skalierter sprachfreier IntelligenztestWeinheim, GermanyBeltz TestGoogle Scholar
2008 Parent ratings of the oppositional defiant disorder symptoms: Item response theory analyses of cross-national and cross-racial invarianceJournal of Psychopathology and Behavioral Assessment 30 10CrossRefGoogle Scholar
1994 Taboo topics among Chinese and English friends: A cross-cultural comparisonJournal of Cross-Cultural Psychology 25 325CrossRefGoogle Scholar
2001 The organisation of Luo conceptions of intelligence: A study of implicit theories in a Kenyan villageInternational Journal of Behavioral Development 25 367CrossRefGoogle Scholar
1977 Language bias in tests: ITPA Grammatic ClosureJournal of Learning Disabilities 10 229CrossRefGoogle Scholar
2005 Adapting educational and psychological tests for cross-cultural assessmentMahwah, NJErlbaumGoogle Scholar
2003 Questionnaire design in comparative researchCross-cultural survey methods19New YorkWileyGoogle Scholar
2006 Response styles in cross-national survey research: A 26-country studyJournal of Cross Cultural Management 6 243CrossRefGoogle Scholar
1996 Filial piety and its psychological consequencesHandbook of Chinese psychology155Hong KongOxford University PressGoogle Scholar
2005 The measurement of implicit motives in three cultures: Power and affiliation in Cameroon, Costa Rica, and GermanyJournal of Cross-Cultural Psychology 36 689CrossRefGoogle Scholar
1989 Effects of culture and response format on extreme response styleJournal of Cross-Cultural Psychology 20 296CrossRefGoogle Scholar
1998 1
2004 Social Axioms: A model for social beliefs in multi-cultural perspectiveAdvances in Experimental Social Psychology 36 119CrossRefGoogle Scholar
2008 Strategies for strengthening causal inferences in cross-cultural research: The consilience approachJournal of Cross Cultural Management 8 145CrossRefGoogle Scholar
2008 Adapting a cognitive test for a different culture: An illustration of qualitative proceduresPsychology Science Quarterly 50 451Google Scholar
1997 Personality trait structure as human universalAmerican Psychologist 52 509CrossRefGoogle ScholarPubMed
2001 Small sample studies to detect flaws in item translationsInternational Journal of Testing 1 115CrossRefGoogle Scholar
1975 Interkulturelle Vergleiche mit dem Matrizentest von FormannUniversity of Vienna, AustriaGoogle Scholar
1989 Equivalence of cross-cultural data: An overview of basic issuesInternational Journal of Psychology 24 737CrossRefGoogle ScholarPubMed
1987 Explaining cross-cultural differences: Bias analysis and beyondJournal of Cross-Cultural Psychology 18 259CrossRefGoogle Scholar
2003 Measurement equivalence of 10 value types from the Schwartz Value Survey across 21 countriesJournal of Cross-Cultural Psychology 34 3CrossRefGoogle Scholar
2003 Is Taijin Kyofusho a culture-bound syndrome?American Journal of Psychiatry 160 1358CrossRefGoogle ScholarPubMed
1997 Culture and psychotherapyHandbook of cross-cultural psychology449Needham Heights, MAAllyn and BaconGoogle Scholar
1991 Test anxiety in primary school students: An empirical study in SingaporeDepartment of Psychology, University of GrazGrazGoogle Scholar
2002 Toward a further understanding of and improvement in measurement invariance methods and proceduresOrganizational Research Methods 5 139CrossRefGoogle Scholar
2000 A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational researchOrganizational Research Methods 2 4CrossRefGoogle Scholar
2003 Bias and equivalence: Cross-cultural perspectivesCross-cultural survey methods143New YorkWileyGoogle Scholar
2008 On the meaning of cross-cultural differences in simple cognitive measuresEducational Research and Evaluation 14 215CrossRefGoogle Scholar
1986 The trainability of abstract reasoning: A cross-cultural comparisonInternational Journal of Psychology 21 589 615CrossRefGoogle Scholar
2009 Structural equivalence and differential item functioning in the Social Axioms SurveyAdvances in research on social axioms51New YorkSpringerGoogle Scholar
2002 Structural and functional equivalence of the Eysenck Personality Questionnaire within and between countriesPersonality and Individual Differences 33 1229CrossRefGoogle Scholar
1997 Bias and equivalence research in the NetherlandsEuropean Review of Applied Psychology 47 319Google Scholar
1970 Translating, working through interpreters, and the problem of decenteringA handbook of cultural anthropology398New YorkAmerican Museum of Natural HistoryGoogle Scholar
- 28
- Cited by