Least-to-Most Prompting
What you'll learn: How to break down complex problems into a sequence of simpler subproblems that build progressively toward the final solution.
Core Idea
Least-to-Most Prompting is a strategy that tackles hard problems by decomposing them into ordered steps, where you solve the easiest parts first and use those solutions as building blocks for harder parts. Unlike standard Chain-of-Thought that reasons through a problem in one go, Least-to-Most explicitly separates the problem into subproblems, solves them sequentially, and feeds each answer forward.
How It Works
The technique involves two stages:
- Decomposition: Prompt the model to break the complex problem into simpler, ordered subproblems
- Sequential Solving: Solve each subproblem in order, including previous solutions in the context for the next step
Analogy
Think of assembling furniture. You don't tackle the entire bookshelf at once. First, you assemble one shelf (easiest). Then you attach the sides using that shelf as reference. Then you add the back panel using what you've built so far. Each step depends on completing the previous one.
Example Structure
Decomposition prompt:
"To solve this problem, what simpler questions should we answer first? List them from easiest to hardest."
Sequential solving prompts:
"Subproblem 1: [question]. Answer: [...]"
"Now using that answer, solve Subproblem 2: [question]. Answer: [...]"
Each subsequent prompt includes all prior subproblem solutions, creating a context chain that builds understanding incrementally.
When to Use It
Least-to-Most excels with compositional reasoning tasks: multi-step math problems, hierarchical planning, or questions requiring prerequisite knowledge. It's particularly powerful when the problem has natural dependencies between subparts.
Key Takeaway: Least-to-Most Prompting decomposes complex problems into sequential, dependent subproblems, solving from simplest to hardest while feeding each solution forward as context for the next step.