Course contentsShow
← Machine Learning and Deep Learning
Lesson 344 of 3,5388. Unsupervised Learning: ClusteringFree lesson

Distance Metrics in K-Means

Why Euclidean distance is standard, alternatives like Manhattan distance, and the impact of metric choice.

Distance Metrics in K-Means

What you'll learn: How different distance metrics affect K-Means clustering and why choosing the right one matters.

Why Distance Matters

K-Means relies entirely on measuring how "close" data points are to cluster centers. The way you measure distance fundamentally changes which points get grouped together. It's like asking "Who's my nearest neighbor?" — the answer depends on whether you're measuring as the crow flies versus walking along city blocks.

Euclidean Distance: The Standard

Euclidean distance is the default in K-Means — it's the straight-line distance you'd measure with a ruler:

distance = sqrt((x1-x2)² + (y1-y2)²)

It works well for most cases because it treats all directions equally and corresponds to our intuitive sense of "closeness." K-Means optimization naturally pairs with Euclidean distance since the mean minimizes squared Euclidean distances.

Manhattan Distance: An Alternative

Manhattan distance (also called L1 or taxicab distance) sums absolute differences along each dimension:

distance = |x1-x2| + |y1-y2|

Think of navigating a grid of city streets — you can't cut diagonally through buildings. This metric is less sensitive to outliers than Euclidean distance and can work better when features represent counts or have different interpretations.

Impact of Metric Choice

The distance metric shapes your clusters:

  • Euclidean creates circular/spherical clusters
  • Manhattan tends toward diamond-shaped boundaries
  • Different metrics can lead to completely different cluster assignments for the same data

However, standard K-Means implementations assume Euclidean distance because the algorithm's "mean" step optimally minimizes squared Euclidean distances. Using other metrics requires algorithmic modifications (like K-Medoids for Manhattan distance).

Key Takeaway: Euclidean distance is K-Means' standard because it mathematically aligns with averaging, but understanding alternatives like Manhattan distance helps you recognize when K-Means assumptions may not fit your data's geometry.