Course contentsShow
← Computer Science
Lesson 2838 of 2,87263. Classical ML AlgorithmsFree lesson

Decision Tree Intuition and Structure

Understanding decision trees as hierarchical models that split data based on feature values to make predictions.

Decision Tree Intuition and Structure

What you'll learn: How decision trees build hierarchical yes/no questions to classify or predict outcomes by recursively splitting data based on feature values.

The Core Idea

Imagine diagnosing why your car won't start. You ask: "Does it have gas?" If no, that's your answer. If yes, you ask: "Does the battery work?" Each question splits possibilities into branches until you reach a conclusion. That's exactly how a decision tree works in machine learning.

A decision tree is a hierarchical model that makes predictions by asking a series of questions about feature values. Starting from the root node, the tree splits data into branches based on feature tests (e.g., "Is age > 30?"). Each internal node represents a test, each branch represents an outcome of that test, and each leaf node represents a final prediction (class label for classification, numeric value for regression).

Structure Components

  • Root Node: The top decision point where all data starts
  • Internal Nodes: Decision points that test a feature and split the data
  • Branches: Paths representing outcomes of tests (e.g., "yes" or "no," or ranges of values)
  • Leaf Nodes: Terminal nodes that output the final prediction

The tree "learns" by choosing splits that best separate the data according to the target label—maximizing information gain or reducing impurity at each step.

Why Trees Matter

Unlike linear or logistic regression, decision trees can naturally model non-linear relationships and interactions between features without manual feature engineering. They're interpretable: you can trace exactly why a prediction was made by following the path from root to leaf.

Key Takeaway: Decision trees recursively partition data using hierarchical feature-based splits, creating an intuitive, interpretable model that captures complex decision boundaries without assuming linearity.