Course contentsShow
← Data Science
Lesson 591 of 2,14515. Regression DiagnosticsFree lesson

When and Why to Transform Variables

Learn when transformations are needed to address non-linearity, heteroscedasticity, or non-normal residuals in regression models.

When and Why to Transform Variables

You'll learn: when and why applying mathematical transformations to your variables can rescue a regression model that violates key assumptions.

Why Transform?

Sometimes your data doesn't naturally fit the assumptions of linear regression. You might discover through residual plots, Q-Q plots, or influence diagnostics that your model suffers from:

  • Non-linearity: The relationship between X and Y curves rather than forming a straight line
  • Heteroscedasticity: Residual variance increases (or decreases) as fitted values change—the "funnel pattern" in residual plots
  • Non-normal residuals: The Q-Q plot shows heavy tails, skewness, or other departures from normality

Rather than abandoning linear regression entirely, you can often transform one or both variables to meet the assumptions.

Common Transformations

Log transformation (log(Y) or log(X)) is the workhorse—it compresses large values and spreads out small ones, often taming right-skewed data and stabilizing variance.

Square root (sqrt(Y)) is gentler than log and works well for count data.

Reciprocal (1/Y) can handle extreme heteroscedasticity but changes interpretation dramatically.

Think of it like adjusting a photograph's contrast: you're not changing what's in the picture, just making the patterns clearer and more linear.

When to Use Them

Check your diagnostics first. If residual plots show patterns (curves, funnels), if the Q-Q plot deviates systematically, or if outliers dominate—these signal transformation might help. Try transforming Y first (easier to interpret), then X if needed.

Key Takeaway: Variable transformations address non-linearity, heteroscedasticity, and non-normality in regression by reshaping the data to better meet linear model assumptions—making your model valid and interpretable.