Course contentsShow
← Machine Learning and Deep Learning
Lesson 1315 of 3,53829. Core NLP TasksFree lesson

Abstractive Summarization Fundamentals

Learn how encoder-decoder models generate summaries that paraphrase source text rather than extracting sentences directly.

Abstractive Summarization Fundamentals

What you'll learn: How encoder-decoder models create summaries by generating new sentences that capture meaning, rather than simply copying text from the source.

What Makes Summarization "Abstractive"?

Abstractive summarization is like explaining a movie to a friend in your own words, rather than reading quotes from the script. The model reads the source document, understands its meaning, and generates a condensed version using novel phrasing—not just extracted sentences.

This contrasts with extractive summarization, which identifies and copies the most important sentences directly from the original text. Abstractive models can paraphrase, combine ideas from multiple sentences, and even use words that never appeared in the source.

How Encoder-Decoder Models Enable Abstraction

Encoder-decoder architectures (like BART and T5) are naturally suited for abstractive summarization:

  1. Encoder phase: The model reads and encodes the entire source document into a rich semantic representation
  2. Decoder phase: Using that understanding, the decoder generates a summary token-by-token through the text generation process you've learned

The decoder isn't limited to copying—it can:

  • Rephrase complex sentences into simpler ones
  • Fuse information from scattered parts of the text
  • Generate connecting words and transitions that create coherent summaries

The Generation Process

During inference, the decoder uses sampling or beam search (strategies you've already studied) to produce each word. It attends to the encoded source representation to stay grounded in the original content while exercising creative freedom in expression.

Key Takeaway: Abstractive summarization uses encoder-decoder models to generate paraphrased, condensed summaries rather than extracting sentences verbatim, enabling more natural and flexible compression of source text.