Generalizability: The extent to which study results can be applied to populations beyond the sample studied.
- Compare Sample to Target Population: Assess similarities and differences
- Identify Key Characteristics: Age, education, demographics, context
- Assess Relevance: Will same factors apply in other contexts?
- Draw Conclusions: Determine scope of appropriate generalization
Sample: Psychology majors, one university, specific age range, educational context
Similar age, educational setting, but different majors and universities
Significant age differences, different cognitive development, different stressors
Different life stage, work stress, different responsibilities
Results may generalize somewhat to college students but not to high school students or working adults due to significant differences in age, life stage, and context.
• Similarity Principle: Greater similarity between sample and population = better generalizability
• Context Matters: Environmental and situational factors affect generalizability
• Demographics: Age, education, and other characteristics limit scope
Internal Validity: The extent to which a study establishes a valid causal relationship between variables. External Validity: The extent to which results can be generalized to other populations and settings.
Random assignment and tight controls strengthen internal validity
Artificial laboratory conditions may limit generalizability to real-world settings
High internal validity often comes at the cost of external validity
Strong causal inferences possible, but limited generalizability to natural settings
Study has high internal validity due to random assignment and controls, but limited external validity due to artificial conditions that may not reflect real-world scenarios.
• Validity Trade-off: Increased internal validity often reduces external validity
• Causal Strength: Internal validity determines strength of causal claims
• Applicability: External validity determines practical relevance
Scope of Inference: The extent to which study conclusions can be applied to populations and relationships beyond the specific study context.
Random sampling from US population → representative sample → broad generalizability
Volunteer sample from fitness center → convenience sample → limited generalizability
Random sampling allows population inferences; volunteer sampling does not
First study allows broader inference due to representative sampling
The first study allows broader scope of inference because random sampling creates a representative sample that permits population-level conclusions.
• Sampling Method: Random sampling enables population inferences
• Representativeness: Representative samples allow broader generalizability
• Volunteer Bias: Volunteer samples often create systematic differences