The Mismeasure of Culture: Why Measurement Invariance Is Rarely Appropriate for Comparative Research in Psychology

Area of Science:

• Social Psychology
• Cross-Cultural Psychology
• Psychometric Methods

Background:

• Growing need for cross-national validation of psychological measures.
• Tension exists between measurement invariance proponents and practitioners.
• Current standards for measurement invariance are often stringent and ambiguous.

Purpose of the Study:

• Critique common applications of measurement invariance standards.
• Propose an alternative method for establishing cross-group validity.
• Demonstrate how to ensure meaningful group differences without strict invariance.

Main Methods:

• Critique of measurement invariance standards in social psychology.
• Proposal of an alternative method using nomological networks.
• Case study using the General System Justification Scale.

Main Results:

• Measurement invariance criteria are often irrelevant for cross-societal comparisons.
• Reliance on nomological networks can ensure meaningful group differences.
• Non-invariance is preferable to approximate (partial) invariance.

Conclusions:

• Psychologists should isolate construct-relevant factors from method bias for cross-group comparisons.
• Defining the scale's purpose and cultural context a priori is crucial.
• Alternative methods can establish cross-group validity more effectively than strict invariance.