Course contentsShow
← AI Engineering
Lesson 543 of 1,88614. Function Calling and Tool UseFree lesson

What is Function Calling in LLMs

Understanding how LLMs can invoke external functions and why this capability extends model usefulness beyond text.

What is Function Calling in LLMs

You'll learn: How modern LLMs can break free from pure text responses and invoke real tools to accomplish tasks.

The Fundamental Problem

Traditional LLMs can only generate text. Ask GPT-3.5 "What's the weather in Paris?" and it might hallucinate an answer or tell you it can't browse the internet. The model has no way to actually fetch real data—it can only predict the next token based on training data.

Function Calling: Bridging Text and Action

Function calling (also called "tool use") is a capability where the LLM can decide when and how to call external functions instead of just generating text. Think of it as giving the model a toolbox: when it recognizes a task requires real-time data or computation, it outputs a structured request to invoke a specific tool.

How It Works (Conceptually)

When you enable function calling:

  1. You define available functions with descriptions (e.g., get_weather(location: str))
  2. The LLM receives both your prompt and the function definitions
  3. The model decides: Should I answer with text, or call a function?
  4. If calling a function: The LLM outputs structured arguments (usually JSON)
  5. Your code executes the actual function with those arguments
  6. You return results to the LLM, which then generates a natural language response

The Analogy

Imagine an assistant who previously could only describe how to check the weather. Now they can pick up a phone (the function) and actually call the weather service. They understand when to use tools, not just talk about them.

Key Takeaway: Function calling transforms LLMs from text generators into agents that can reason about and trigger real-world actions, dramatically expanding what AI applications can accomplish beyond static knowledge.