Course contentsShow
← Machine Learning and Deep Learning
Lesson 2440 of 3,53853. Speech and Audio ProcessingFree lesson

Mel-Frequency Cepstral Coefficients (MFCCs)

Computing MFCCs as compact feature representations that capture timbral characteristics of speech.

Mel-Frequency Cepstral Coefficients (MFCCs)

What you'll learn: How MFCCs compress spectral information into compact features that capture the unique timbral "fingerprint" of speech and audio.

The Core Idea

After computing a mel-spectrogram (which shows frequency content aligned with human hearing), we still have a large 2D representation. MFCCs take this further by applying a discrete cosine transform (DCT) to the log mel-spectrogram's frequency bins, producing a small set of coefficients—typically 13-40 values per time frame—that efficiently encode the spectral envelope.

Think of it like this: if a mel-spectrogram is a detailed photograph of sound's frequency content, MFCCs are like a compressed JPEG that keeps the essential patterns while discarding redundant information. The first few coefficients capture the broad shape of the spectrum (the "color" or timbre), while higher coefficients represent finer details.

Why MFCCs Matter

The DCT decorrelates the mel-frequency bins, concentrating energy into the first few coefficients. This means:

  • Dimensionality reduction: Instead of hundreds of frequency bins, you get ~13-20 meaningful numbers
  • Timbral capture: They excel at distinguishing different phonemes (speech sounds) or musical timbres
  • Efficient processing: Compact features make downstream ML models faster and often more accurate

The Pipeline

  1. Start with audio waveform
  2. Compute STFT → spectrogram
  3. Apply mel filterbank → mel-spectrogram
  4. Take logarithm (models human loudness perception)
  5. Apply DCT → MFCCs

Key Takeaway: MFCCs transform mel-spectrograms into compact, decorrelated features that efficiently represent the timbral characteristics of speech, making them a foundational feature representation in audio classification, speech recognition, and speaker identification tasks.