Course contentsShow
← AI Engineering
Lesson 118 of 1,8863. API-First AI EngineeringFree lesson

Token Counting and Cost Estimation

Calculate token usage for prompts and completions to accurately predict costs before making API calls.

Token Counting and Cost Estimation

What You'll Learn

You'll learn how to calculate the number of tokens in your prompts and expected completions so you can accurately predict API costs before making requests.

Why Token Counting Matters

From the previous lesson, you know that LLM APIs charge based on tokens—typically separate prices for input (prompt) tokens and output (completion) tokens. But how do you know how many tokens a piece of text contains before sending it to the API?

The core challenge: Text length in characters doesn't directly translate to token count. The word "artificial" might be one token, while "AI" could also be one token despite being much shorter. Most models use subword tokenization, where common words are single tokens but rare or long words split into multiple pieces.

How to Count Tokens

Each API provider offers tokenizer libraries that match their models' exact counting logic:

  • OpenAI: Use the tiktoken library to count tokens for GPT models
  • Anthropic: Use their anthropic SDK's counting utilities
  • General principle: The tokenizer breaks text into the same pieces the model will see

Think of it like estimating shipping costs: you need to know the exact weight before the package ships, using the same scale the shipping company uses.

Estimating Total Cost

Formula:

Total Cost = (Input Tokens × Input Price) + (Output Tokens × Output Price)

For the output, you'll estimate based on your max_tokens setting or typical response length. Always add a safety margin—if you expect 500 output tokens, budget for 600-700.

Key Takeaway: Use provider-specific tokenizer libraries to count tokens in your prompts and estimate completion length, then multiply by the pricing model to predict costs before making API calls.