Business Metrics: CTR and Conversion
What you'll learn: How recommendation quality translates into measurable business outcomes through click-through and conversion rates.
Why Business Metrics Matter
You've learned metrics like Precision@K and NDCG that measure how good your recommendations are from an algorithmic perspective. But companies ultimately care about whether users act on those recommendations. That's where Click-Through Rate (CTR) and Conversion Rate come in—they measure actual user engagement and revenue impact.
Click-Through Rate (CTR)
CTR measures what percentage of recommended items users actually click on:
CTR = (Number of Clicks) / (Number of Impressions) × 100%
If you show 1,000 product recommendations and get 50 clicks, your CTR is 5%. Higher CTR means your model is successfully predicting what captures user attention—though attention doesn't always equal satisfaction or purchase.
Conversion Rate
Conversion Rate goes deeper—it measures completed desired actions (purchases, sign-ups, subscriptions):
Conversion Rate = (Number of Conversions) / (Number of Clicks or Impressions) × 100%
A recommendation might have high CTR (users click) but low conversion (users don't buy). This tells you the model creates interest but perhaps not relevance or value.
The Connection to Recommendation Quality
Think of it like a sales funnel: your Neural Collaborative Filtering model generates candidates, the ranking system orders them, and then real users decide. A high NDCG score suggests good ranking, but if CTR is low, users disagree with your model's choices. If conversion lags CTR, you might be recommending clickbait rather than genuinely useful items.
These metrics close the loop between offline evaluation and real-world performance, guiding model improvements that actually grow the business.
Key Takeaway: CTR measures engagement with recommendations while conversion rate measures completed business goals; together they reveal whether your recommender system drives actual value beyond algorithmic accuracy scores.