Random Assignment in Experiments: Complete Guide with Exercises and Detailed Summary

Master random assignment in experiments: principles, methods, importance for causation, and practical applications through detailed examples and exercises.

Exercises 1 to 3: Solutions
1 Random Assignment Process
Exercise 1
A researcher has 60 participants for a drug trial. She wants to assign 30 to the treatment group and 30 to the control group. Describe the proper random assignment process and explain why this method is crucial.
Key Definition:

Random Assignment: The process of allocating participants to experimental groups using chance, ensuring each participant has an equal probability of being assigned to any group.

Assignment Process:
  1. Number all 60 participants from 1 to 60
  2. Use a random number generator to create a sequence
  3. Assign first 30 numbers to treatment group, remaining 30 to control
  4. Document the assignment sequence for reproducibility
Step 1: Create numbered list

Participants: 1, 2, 3, ..., 60

Step 2: Generate random sequence

Random number generator produces: 45, 12, 33, 7, 29, ...

Step 3: Assign to groups

First 30 in sequence → Treatment group, last 30 → Control group

Step 4: Document process

Record assignment method for transparency and validation

Equal probability assignment to treatment and control groups
Final Answer:

Number participants 1-60, use random generator to assign first 30 to treatment and last 30 to control. This ensures equal probability and balances confounding variables.

Key Rules:

• Equal Probability: Every participant has same chance of group assignment

• Chance Determination: Assignment based solely on random mechanism

• Balance Confounding: Randomization averages out differences between groups

Tip: Use computer software or random number tables, not coin flips for large samples.
2 Balancing Confounding Variables
Exercise 2
In a study comparing two teaching methods, participants have varying levels of prior knowledge. Explain how random assignment helps balance this confounding variable and why this is important for causal inference.
Key Definition:

Confounding Variable: A variable that affects both the independent variable (treatment) and the dependent variable (outcome), potentially creating spurious associations.

Step 1: Identify the confounding variable

Prior knowledge affects both teaching method effectiveness and learning outcomes

Step 2: Understand randomization effect

Random assignment distributes prior knowledge equally across groups on average

Step 3: Assess impact on causal inference

With balanced prior knowledge, differences in outcomes can be attributed to teaching methods

Step 4: Confirm causal validity

Random assignment enables valid causal conclusions about teaching method effectiveness

Random assignment balances confounding variables across groups
Final Answer:

Random assignment ensures both groups have similar distributions of prior knowledge, allowing causal attribution to teaching methods rather than pre-existing differences.

Key Rules:

• Statistical Balance: Randomization balances all variables (known and unknown)

• Causal Validity: Only random assignment allows for causal inferences

• Probability Distribution: Groups are equivalent on average before treatment

Tip: Random assignment balances both observed and unobserved confounding variables.
3 Random Assignment vs Random Sampling
Exercise 3
Explain the difference between random assignment and random sampling. Which is necessary for causation and which for generalizability?
Key Definition:

Random Sampling: Selecting participants from the population using chance. Random Assignment: Allocating selected participants to experimental groups using chance.

Step 1: Define random sampling

Selecting participants from population using probability methods (ensures representativeness)

Step 2: Define random assignment

Allocating selected participants to treatment/control groups using chance (ensures equivalence)

Step 3: Identify purposes

Random sampling → generalizability; Random assignment → causation

Step 4: Explain relationship

Both are important but serve different inferential purposes

Random Sampling: Generalizability | Random Assignment: Causation
Final Answer:

Random sampling ensures representative sample for generalization; random assignment ensures group equivalence for causal inference. Both are needed for strong experiments.

Key Rules:

• Random Sampling: Enables population inferences (external validity)

• Random Assignment: Enables causal inferences (internal validity)

• Combined Power: Both together provide strongest experimental design

Random Assignment Principles and Benefits
\(\text{Causal Effect} = E[Y_{\text{treatment}}] - E[Y_{\text{control}}]\)
Causal Effect Estimation
Random Assignment Process
Step 1: List all participants in experiment
Step 2: Use random mechanism (computer, random table)
Step 3: Assign participants based on random sequence
Step 4: Document assignment for transparency
Benefits of Random Assignment
Equivalence: Groups are statistically equivalent before treatment
Balance: Known and unknown confounding variables balanced
Causation: Enables valid causal inferences
Statistical Validity: Allows use of statistical significance tests
Participants
→
Random Assignment
→
Treatment Groups
→
Outcome Comparison
Key Terms: Treatment Group (receives intervention), Control Group (does not receive intervention), Placebo Effect (psychological response to treatment expectation)
Statistical Foundation: Random assignment creates baseline equivalence for causal inference
Exercises 4 to 5: Solutions
4 Assignment Probability Calculations
Exercise 4
In a clinical trial with 100 participants, 50 will be assigned to the treatment group and 50 to the control group. What is the probability that a specific participant will be assigned to the treatment group? What happens to this probability as more people are assigned?
Key Definition:

Assignment Probability: The likelihood that a participant will be assigned to a particular experimental group during random assignment.

Step 1: Calculate initial probability

Initially: 50 treatment spots available out of 100 total spots → P = 50/100 = 0.5 or 50%

Step 2: Analyze probability evolution

After each assignment, available spots decrease in one group, but probability depends on remaining pool

Step 3: Consider overall design

Using complete randomization (all assignments determined simultaneously), each person has 50% chance

Step 4: Confirm equal probability

Proper randomization ensures equal probability regardless of assignment order

Each participant has 50% probability of treatment assignment
Final Answer:

Each participant has a 50% probability of assignment to treatment group, maintained through proper randomization procedures.

Applied Rules:

• Equal Probability: All participants must have identical assignment chances

• Simultaneous Assignment: Determine all assignments at once to maintain probabilities

• Transparency: Document randomization method for verification

5 Blocking and Random Assignment
Exercise 5
A study has 40 participants: 20 males and 20 females. The researcher wants to ensure gender balance in both treatment groups. How can blocking be combined with random assignment to achieve this?
Key Definition:

Blocking: A technique that divides participants into homogeneous subgroups (blocks) before random assignment to ensure balance on important variables.

Step 1: Create blocks

Create two blocks: Block 1 (20 males), Block 2 (20 females)

Step 2: Random assignment within blocks

Randomly assign 10 males to treatment, 10 to control; same for females

Step 3: Combine groups

Treatment group: 10 males + 10 females; Control group: 10 males + 10 females

Step 4: Verify balance

Both groups have identical gender distribution (50% male, 50% female)

Blocked Random Assignment: Gender-balanced treatment groups
Final Answer:

Use blocking by gender: create male and female blocks, then randomly assign within each block to ensure balanced gender distribution in both groups.

Applied Rules:

• Block Creation: Group by important variables before randomization

• Within-Block Randomization: Maintain random assignment within each block

• Balance Achievement: Blocking guarantees balance on specified variables

Detailed Summary: Random Assignment in Experiments
\(\text{Expected Difference} = \text{True Causal Effect} + \text{Bias}\)
Causal Inference Equation
Core Definitions:

Random Assignment: The process of allocating experimental units to treatment groups using chance, ensuring each unit has an equal probability of assignment to any group.

Confounding Variable: A variable that influences both the independent variable and the dependent variable, potentially creating spurious associations.

Internal Validity: The extent to which a study establishes a valid causal relationship between variables.

External Validity: The extent to which study results can be generalized to other populations or settings.

Blocking: A technique that groups similar experimental units together before random assignment to ensure balance on important variables.

Random Assignment Procedures:
  1. Preparation: List all participants and define treatment groups
  2. Randomization: Use computer software, random number tables, or other random mechanisms
  3. Implementation: Assign participants based on random sequence
  4. Documentation: Record assignment method and results for transparency
Tip 1: Always use computer-based randomization for larger studies to avoid human bias.
Tip 2: Consider blocking for important variables to enhance precision and balance.
Tip 3: Document your randomization procedure completely for replication and validation.
Tip 4: Never modify assignments after randomization unless following pre-specified protocols.
Common Mistakes: Post-hoc assignment modifications, inadequate documentation, confusing with random sampling, failing to balance important variables.
Exam Focus: Distinguishing random assignment from random sampling, explaining causal inference, identifying confounding variables, understanding blocking.
Critical Principles:

• Equal Probability: Every participant must have identical assignment probability

• Chance Determination: Assignment must be based solely on random mechanism

• Baseline Equivalence: Groups should be equivalent before treatment begins

• Causal Inference: Only random assignment enables valid causal conclusions

• Transparency: Assignment procedures must be documented and reproducible

\(\text{SE}_{\text{difference}} = \sqrt{\frac{s_1^2}{n_1} + \frac{s_2^2}{n_2}}\)
Standard Error of Difference

Questions & Answers

Question: Why is random assignment necessary for causation but random sampling isn't? Can't we just use random sampling and get the same results?

Answer: These serve completely different purposes:

  • Random Sampling: Ensures your sample represents the population (generalizability)
  • Random Assignment: Ensures groups are equivalent before treatment (causation)

Key Point: You can have a perfectly random sample but still have systematic differences between groups if you don't randomize assignment. Random assignment is what creates the baseline equivalence needed for causal inference.

Example: Randomly sample 100 people, but assign all tall people to treatment and all short people to control - you have good sampling but no causal validity!

Question: What's the difference between blocking and stratification? Aren't they the same thing?

Answer: While similar in concept, they're used in different contexts:

  • Blocking: Used in experiments during random assignment (before treatment)
  • Stratification: Used in sampling to ensure representation from different groups

Process Similarity: Both involve dividing into homogeneous groups first, then applying randomization within groups.

Example: In an experiment, you might block by age (create age blocks, then randomize within each block). In sampling, you might stratify by age (ensure representation from each age group).

The key difference is timing: blocking happens during assignment, stratification during selection.

Question: How does random assignment handle variables we don't know about? How can it balance everything?

Answer: This is the beautiful mathematical property of randomization:

  • Probability Theory: On average, random assignment balances ALL variables (known and unknown)
  • Law of Large Numbers: As sample size increases, groups become more equivalent
  • Statistical Guarantee: The expected difference between groups is zero for all variables

How It Works: Each participant has equal probability of assignment regardless of their characteristics. This means that any variable (age, gender, income, personality traits, genetic factors) gets distributed equally on average across groups.

It's like flipping coins - over many flips, heads and tails balance out. Similarly, random assignment balances all participant characteristics across groups.