AP Statistics · Unit 4 · Topic 4.10

Carrying Out a Test for a Difference in Means Study Lab

A two-sample t-test asks whether the difference between two sample means is too big to blame on chance alone. Enter the data and hypotheses to see the test statistic, the p-value as a shaded area, and the decision. A complete State, Plan, Do, Conclude answer is written out for you as you change things.

1. Run a two-sample t-test

Enter the summary statistics, the hypothesized difference, the direction of the alternative, and α. The test statistic, p-value, and a complete four-step answer update as you type.

t = ((x̄₁ − x̄₂) − 0) ÷ √( s₁²/n₁ + s₂²/n₂ ) p-value = area beyond t in the direction of Hₐ
Preset studies

Sample data and hypotheses

Group 1
Group 2
Hₐ: μ₁ − μ₂
0
Usually 0: "no difference."
Significance level α

p-value as an area

t distribution if H₀ is trueObserved t

Matching confidence interval

Test statistic t
df (calculator)
p-value
Decision

The four steps

Show your work

2. Key ideas

Test statistic

How many standard errors away?

t measures how far the observed difference x̄₁ − x̄₂ is from the hypothesized difference, in standard errors. Far from 0 (in the direction of Hₐ) means the data are surprising if H₀ is true.

p-value

Assume H₀, then ask "how unusual?"

The p-value is the probability, assuming H₀ is true, of getting a difference in sample means at least as extreme as the one observed, in the direction of Hₐ. Two-sided tests count both tails.

Decision

Compare p with α

If p ≤ α, reject H₀: there is convincing evidence for Hₐ. If p > α, fail to reject H₀: there is not convincing evidence for Hₐ. Never "accept" H₀.

df

Calculator vs. conservative

Technology uses the Welch df. With a table, use the smaller of n₁ − 1 and n₂ − 1. The conservative df gives a slightly larger p-value, so it is less likely to reject.

Errors

What could go wrong?

Rejecting a true H₀ is a Type I error (probability α). Failing to reject a false H₀ is a Type II error. Larger samples raise power, the chance of correctly rejecting a false H₀.

Scope

Cause or generalize?

With random assignment, a significant difference can be attributed to the treatments. With random samples, the conclusion applies to the populations sampled. Without either, be cautious.

3. Quick reference

How the alternative hypothesis decides the p-value, using t = 2.10 with df = 40 as an example.

4. On the FRQ

The four steps graders look for

  • State: hypotheses with μ₁ and μ₂ defined in context, and α.
  • Plan: name the two-sample t-test and check Random, 10%, and Normal/Large sample for each group.
  • Do: the test statistic with values plugged in, df, and the p-value.
  • Conclude: compare p with α, make a decision about H₀, and state the conclusion in context about Hₐ: "Because p = 0.012 < 0.05, we reject H₀. There is convincing evidence that…"

Common mistakes

  • Concluding "H₀ is true" or "there is no difference" after a large p-value.
  • Interpreting the p-value as the probability that H₀ is true.
  • Forgetting to double the one-tail area for a two-sided test.
  • Writing a conclusion about the sample means ("x̄₁ is larger") instead of the population means.
  • Claiming cause and effect from an observational study.

5. Practice questions

AP-style multiple choice. Pick an answer to see the explanation.

0 / 0 correct

6. Key terms

The vocabulary for topic 4.10. Read the list, flip through flashcards, or quiz yourself. For every term in the unit, see the Unit 4 terminology guide.