AP Statistics · Unit 1 · Topic 1.12

Potential Problems with Sampling Study Lab

A sampling method is biased if it tends to produce estimates that are systematically too high or too low. Bias comes from how the data are collected, and a bigger sample does not fix it. Survey a simulated town about a new skate park six different ways and see which methods miss, in which direction, and why.

1. Survey the town

The town has 2,000 adults. Younger adults are much more likely to support the skate park. The true proportion who support it is the parameter p.

Method

Changing n clears the results so each run uses one sample size.

Who answered this survey

TownThis survey's respondents

Estimates p̂ from repeated surveys

True pEach survey's p̂
True proportion p
This survey's p̂
Average p̂ (center)
Bias (average p̂ − p)

This survey, step by step

All methods so far

Bias shows up as a center far from p. Variability shows up as spread (SD). Bigger n shrinks the SD, not the bias.

Name that bias

For each survey, choose the main source of bias.

2. Key ideas

Bias

Systematically off

A method is biased when it tends to over- or underestimate the parameter, survey after survey. Random chance error goes both ways; bias pushes one way.

Undercoverage

Some people can't be chosen

Part of the population has little or no chance of being in the sample, like people without landlines in a landline phone survey.

Nonresponse

Chosen but didn't answer

Individuals selected for the sample can't be reached or refuse to respond, and the people who don't respond differ from those who do.

Response bias

The answers are off

People give inaccurate answers because of question wording, the interviewer, a sensitive topic, or wanting to look good. It happens even with a perfect random sample.

Voluntary response

People choose themselves

An open call (online poll, call-in show) attracts people with strong opinions, usually negative ones. The sample chooses itself, so it is not random.

Convenience

Easy to reach

Choosing whoever is easy to reach, like customers at one store, gives a sample that often differs from the population in ways related to the question.

3. Explaining the direction of bias

Full credit names the bias, explains who is missing or misrepresented, and says which way the estimate is pushed.

SurveyBiasWhyDirection
Skate park poll on the parks department websiteVoluntary responseSupporters care more and are more likely to vote onlineOverestimates support
Interviewing customers at the local skate shopConvenienceShop customers are mostly young skaters who want the parkOverestimates support
Random landline phone numbersUndercoverageFew young adults have landlines, and they support the park mostUnderestimates support
Random mail survey; mostly older adults mail it backNonresponseYoung adults who were chosen rarely respond, and they differ in opinionUnderestimates support
"Do you support wasting tax money on a skate park?"Response bias (wording)The loaded words push people toward "no"Underestimates support

4. On the FRQ

How to earn the points

  • Name the specific bias, then describe the mechanism in context: who is over- or underrepresented and why their answers differ.
  • State the direction: "This would likely overestimate the proportion of residents who support the skate park."
  • For nonresponse, make clear the people were selected but did not respond. For undercoverage, they could not be selected in the first place.
  • Suggest a fix that matches the problem: random selection for convenience or voluntary samples, follow-ups for nonresponse, neutral wording for response bias.

Common mistakes

  • Saying "the sample is too small, so it's biased." Small samples are more variable, not biased.
  • Saying "increase the sample size" to fix bias. A bigger biased sample is just more precisely wrong.
  • Mixing up nonresponse and voluntary response. Voluntary response: people choose to join. Nonresponse: people were chosen but didn't answer.
  • Naming a bias without explaining the direction it pushes the estimate.

5. Practice questions

AP-style multiple choice. Pick an answer to see the explanation.

0 / 0 correct

6. Key terms

The vocabulary for topic 1.12. Read the list, flip through flashcards, or quiz yourself. For every term in the unit, see the Unit 1 terminology guide.