In mathematics and statistics, linear regression is a method for modeling the relationship between two variables using a straight line — called the line of best fit — that best represents the trend in a scatter plot. The regression equation is written as ŷ = a + bx, where b is the slope (rate of change) and a is the y-intercept (predicted value when x = 0). Linear regression appears in Florida’s MAFS.912.S-ID.6 standards, AP Statistics, and the SAT Math Problem Solving & Data Analysis section.

"Regression" Explained

Linear Regression: Line of Best Fit & SAT Guide

Linear regression models the relationship between two variables with a straight line, the line of best fit, that best represents the trend in a scatter plot. The equation is ŷ = a + bx, where b is the slope (rate of change) and a is the y-intercept (predicted value when x = 0). Tested on the SAT Math “Problem Solving & Data Analysis” section.

Scatterplot with a line of best fit illustrating linear regression

DEFINITION

What Is Linear Regression?

Linear regression is a statistical method for finding the straight line that best models the relationship between two quantitative variables. This line , the regression line or line of best fit , minimizes the total distance between itself and all the data points. The equation predicts the dependent variable (ŷ, “y-hat”) for any value of the independent variable x, making it a tool for both analysis and prediction.

💻

Calculator tip: on the SAT calculator section, plug the data points into a DESMOS table and use its regression feature to get the equation instantly: faster and less error-prone than a TI-84[cite: 8].

THE EQUATION

The Linear Regression Formula (ŷ = a + bx)

Same structure as slope-intercept form, different notation. Interpreting what each part means in context is the skill the SAT actually tests,not memorizing the equation.

ŷ = a + bx
  • ŷ (y-hat): the predicted value of the dependent variable
  • x: the independent variable (the input or predictor)
  • b: slope: the predicted change in ŷ for every 1-unit increase in x
  • a: y-intercept: the predicted value of ŷ when x = 0

Interpret the slope in context: "for every 1-unit increase in x, ŷ increases/decreases by b": always in real-world units. For ŷ = 12.5 + 3.2x (x = study hours, ŷ = test score): each extra hour adds a predicted 3.2 points. The SAT's "what does 3.2 represent?" answer is always a rate[cite: 9].

⚠️

TI-84 vs. statistical notation: the TI-84's LinReg output shows "y = ax + b" where a = slope, b = intercept: the opposite of AP Statistics notation (ŷ = a + bx, where a = intercept)[cite: 9]. Don't copy blindly. Identify slope by position: the coefficient of x is always the slope, whatever letter the calculator uses[cite: 9].

STEP BY STEP

Regression — Three Worked Examples

READ · EASY

A line of best fit is ŷ = 4.5 + 2.3x, where x = practice problems done and ŷ = predicted quiz score. Find and interpret the slope and y-intercept.

  1. Slope → coefficient of x → b = 2.3
  2. Y-intercept → the constant → a = 4.5
  3. Slope in context → each extra practice problem adds a predicted 2.3 points
  4. Y-intercept in context → a student doing 0 problems is predicted to score 4.5
Slope = 2.3 (pts per problem) · Y-intercept = 4.5 (predicted score at 0)
CONTEXT · MEDIUM

ŷ = −320 + 15x models daily ice-cream sales (ŷ, in $) based on temperature (x, in °F). What do 15 and −320 represent?

  1. 15 → coefficient of x → the slope
  2. In context → each 1°F rise predicts a $15 increase in sales
  3. −320 → the constant → the y-intercept
  4. In context → at 0°F, predicted sales are −$320 (outside the practical data range)
15 = sales increase per 1°F · −320 = predicted sales at 0°F

SAT insight: a negative y-intercept isn't an error — 0°F is just outside the data range, so the intercept has no real-world meaning here. Focus on what the slope represents.

RESIDUAL · HARD (SAT/AP)

Using ŷ = −320 + 15x, predict sales at 85°F. Actual sales were $975: find the residual and say whether the model over- or underestimated.

  1. Substitute → ŷ = −320 + 15(85) = −320 + 1,275 = 955
  2. Predicted → $955
  3. Residual = Actual − Predicted → 975 − 955 = +20
  4. Positive residual → actual > predicted → model underestimated
Predicted $955 · Residual +$20 · Model underestimated

Remember: Residual = Actual − Predicted (never reversed). Positive = point above the line = underestimate. Negative = below the line = overestimate.

HOW STRONG?

The Correlation Coefficient (r)

r measures the strength and direction of a linear relationship. It runs from −1 to +1, the sign is the direction, the magnitude is the strength. But r never proves that x causes y.

−1 0 +1
strong − none strong +

Strong

|r| ≥ 0.8

Points cluster tightly around the line; direction is clear; predictions are reliable within the data range.

Moderate

0.5 ≤ |r| < 0.8

A trend with more spread; predictions are directionally right but less precise. Still useful for general estimation.

Weak / None

|r| < 0.5

Little to no linear pattern; points are scattered widely. The regression line is an unreliable predictor.

r² (coefficient of determination): the proportion of variation in y explained by the linear relationship with x. If r = 0.8, then r² = 0.64 → the model explains 64% of the variation in y.

PROBLEM SOLVING AND DATA ANALYSIS

Regression on the SAT Math Section

Scatter plots with lines of best fit appear on every SAT Math section, 2–4 questions. Knowing the question formats in advance, not just the formula, is what converts regression knowledge into points.

SAT QUESTION TYPE WHAT IT TESTS FREQUENCY
Interpret the slope in context "What does the value X represent?" – slope as a real-world rate 2–3× per test
Make a prediction Substitute an x-value into ŷ = a + bx 1–2× per test
Over- or underestimate Compare a point to the line – above = underestimate, below = overestimate 1× per test
Interpret the y-intercept What the intercept means in context (often outside the data range) 1× per test
Describe the association Positive / negative / none from the scatter or the sign of r 1× per test

SAT Strategy — Regression Questions

Read the units · Identify slope as a rate · Never say "correlation proves causation"

1

For "what does X represent?" – always answer with units: "for every 1 [x-unit] increase, ŷ increases by [b] [y-units]." Never just the number.

2

For over/underestimate – find the point. Above the line → actual > predicted → underestimate. Below → overestimate.

3

Never conclude causation from a regression equation. "Does this prove X causes Y?" → the answer is always no. Regression shows association.

AVOID THESE

4 Common Regression Mistakes

Correlation Proves Causation

Ice cream sales and drownings both rise in summer: but ice cream doesn't cause drownings. Regression shows association, not cause.

Fix: use "is associated with," "predicts," or "is related to" – never "causes," "leads to," or "proves."

TI-84 vs. Statistical Notation

The TI-84 shows "y = ax + b" (a = slope); textbooks use ŷ = a + bx (a = intercept). Copying blindly flips the two.

Fix: identify slope by position – the coefficient of x is always the slope, whatever letter is used.

Extrapolating Beyond the Data

Predicting y at x-values far outside the observed range gives unreliable estimates – the linear model only holds near the data.

Fix: if asked to predict far outside the range, the answer is "unreliable / shouldn't be trusted" – a data-literacy question type.

Residual Sign Reversed

Computing "predicted − actual" instead of "actual − predicted" flips every over/underestimate answer.

Fix: Residual = Actual − Predicted, always. Positive = above line = underestimate; negative = below = overestimate.

TRY THESE

Practice Problems

All use ŷ = 8.2 + 1.7x (x = hours of exercise/week, ŷ = resting heart-rate reduction in bpm). Work each, then reveal.

SLOPE MEANING

What does the slope represent in this context?

PREDICTION

Predict the heart-rate reduction for someone who exercises 6 hours per week.

RESIDUAL

A person exercising 6 hrs/week achieved a 21 bpm reduction. Over- or underestimate? Residual?

CORRELATION

A scatter plot has r = −0.91. What does the sign tell you? The magnitude? Does it prove causation?

FREQUENTLY ASKED

Regression — FAQ

Linear regression is a statistical method for finding the straight line — the line of best fit — that best models the relationship between two quantitative variables in a scatter plot. The equation is ŷ = a + bx, where b is the slope (rate of change) and a is the y-intercept (predicted value when x = 0). It's covered in Florida's MAFS.912.S-ID.6 standards and tested on the SAT Math Problem Solving & Data Analysis section.

KEEP EXPLORING

Related Statistics Concepts

SAT Data Analysis Giving You Trouble?

Regression and scatter plots are among the fastest SAT points to recover. Book a free math assessment and get a personalized Digital SAT plan.