Unit 5 · Data · Lesson 5.10

Bias in Data, and What’s Missing

Every dataset is a picture of whoever got counted. Today: whose rows are missing, why, and what that does to every answer you compute — no matter how correct your code is.

Big Idea 2 — DataCED 2.3, 5.3 · Unit 8 handoff

Before this lesson

No reading — this page is the reading. Runestone doesn’t cover sampling bias; it comes back in Unit 8 with the AI chapters.

1

Where We Are

People→ Bits→ Programs→ Internet→ Security→ Big Data→ Impact

Big Data, reaching toward Impact. 5.9 asked what data can’t prove. Today asks what data never captured. Both are the bridge to Unit 8.

2

The Hook

A street-safety app builds a map from user reports. Red where people report problems, green where they don’t. Whose neighborhoods get reported? Whose don’t? So what does the map actually show — danger, or who downloaded the app?
3

The Idea

A sample is the part of a population that actually ends up in your data. A sample is representative when it matches the whole population on the things that matter for your question. When the way data is collected systematically leaves some people or situations out, the data has bias — and every result computed from it inherits that bias.

Source of biasExample
Who has accessAn app-based survey can’t hear from people without the app or a phone.
Who volunteersOnline polls hear from people who feel strongly.
Where and when you askA survey at 2 PM on a weekday misses people at work.
What was never recordedNo column for it → no answer about it. Ever.
Who survivedStudying only the companies still in business hides the ones that failed.
More data doesn’t fix biased data. A million responses from the same skewed source is a very precise answer to the wrong question. The fix is in how data is collected, not how much.
4

Try It — Danger, or Downloads?

Four neighborhoods, same size, and in this simulation the same number of real incidents — 20 each. The only difference: how many residents have the app. Flip between what the app sees and what actually happened.

Representative or biased?

R = representative by design · B = biased sample.

5

Vocabulary

bias Big Data
A systematic tilt in data or results, often because of how the data was collected or who was left out.
sample Big Data
The subset of a population that is actually included in the data.
representative Big Data
Describes a sample that matches the whole population on the characteristics that matter for the question.
6

Check

Five questions. For every dataset: who’s missing?

0 of 5 answered
7

Impact Check

This is the Unit 8 handoff

In April you’ll study AI systems that make decisions — who gets a loan, which résumé gets read, where patrols go. Those systems learn from datasets like the ones in this unit. When the data leaves people out, the system does too. You’re not meeting that idea fresh in April — you’re meeting it today.

8

Connections

Came from Mini-Project 3 — your simulation’s abstraction paragraph: what the model left out. Same reasoning, real stakes.
Came from 5.6 — dropping incomplete rows can remove a whole group — bias created by cleaning.
Next in 5.11 — Mini-Project 4. The paragraph worth the most points asks exactly today’s question.
Returns in Unit 8 — algorithmic bias. Same idea, with software making the decisions.
← 5.9 Correlation, Causation, and Bad Claims