Cost per Interaction and Unit Economics
What you'll learn: You'll learn how to calculate the true all-in cost of each AI interaction to understand profitability and sustainability.
Why Cost Per Interaction Matters
Every time a user sends a message to your AI system, you incur costs: inference API calls, infrastructure compute, storage, monitoring, and human oversight. Understanding your cost per interaction is essential to determining whether your AI product is financially viable at scale.
Components of Fully-Loaded Cost
To calculate the true cost per interaction, include:
- Inference Costs: Token usage charges from LLM providers (input + output tokens)
- Infrastructure: Vector database queries, embeddings generation, caching layers
- Data Transfer: API bandwidth, CDN costs
- Operational Overhead: Logging, monitoring, error tracking services
- Human-in-the-Loop: Review workflows, escalations, support
- Storage: Conversation history, audit logs, user context
The Formula
Cost per Interaction = (Total Monthly Costs) / (Total Monthly Interactions)
For deeper insight, segment by interaction type (simple vs complex), user tier, or feature usage.
Unit Economics Example
Imagine your AI assistant costs:
- $0.015 per inference (GPT-4 call)
- $0.002 for embeddings lookup
- $0.003 infrastructure + monitoring
Total: $0.020 per interaction
If your average revenue per user is 10 - (200 × 10 - 6 profit/user`
Key Takeaway: Fully-loaded cost per interaction reveals whether your AI product can scale profitably — track it obsessively and optimize aggressively to maintain healthy unit economics as usage grows.