What is Simple Linear Regression?
You'll learn: How to model the relationship between two quantitative variables using a straight line to make predictions and understand associations.
The Core Idea
Simple linear regression is a statistical method that models the relationship between two quantitative variables by fitting a straight line through their data points. Think of it as drawing the "best" line through a scatter plot to capture the overall trend.
You've already seen scatter plots (lesson 2996) and correlation—regression takes this further by creating an actual mathematical equation that describes how one variable (the predictor or independent variable, often called x) relates to another (the response or dependent variable, called y).
Why a Straight Line?
Imagine you're trying to predict someone's weight based on their height. If you plotted height vs. weight for many people, you'd see a positive association—taller people tend to weigh more. Simple linear regression finds the line of the form:
y = β₀ + β₁x + ε
where:
- β₀ (beta-zero) is the y-intercept
- β₁ (beta-one) is the slope—how much y changes for each unit increase in x
- ε (epsilon) represents random error or variation not explained by the line
The goal is to estimate β₀ and β₁ from your data using methods like least squares (which minimizes the sum of squared differences between observed values and the line's predictions).
Real-World Analogy
It's like finding the "average path" through a cloud of points. Not every point sits perfectly on the line, but the line captures the central tendency of the relationship.
Key Takeaway: Simple linear regression models how two quantitative variables relate by fitting a straight line, allowing you to describe, quantify, and predict one variable based on the other.