Course contentsShow
← Data Science
Lesson 1159 of 2,14529. Data Wrangling WorkflowsFree lesson

What is Data Lineage?

Understanding data lineage as the complete journey of data from source to final output, including all transformations.

What is Data Lineage?

You'll learn: What data lineage means and why tracking the complete journey of your data matters in data wrangling workflows.

The Complete Data Journey

Data lineage is the documented history of data from its original source through every transformation, merge, filter, and calculation until it reaches its final form in a report, model, or dashboard. Think of it like a family tree for your data—it shows where each piece came from, what happened to it along the way, and how it ended up in its current state.

Imagine you're baking a cake and someone asks, "Where did this ingredient come from?" Data lineage lets you trace back: the flour came from the pantry, which was bought at Store X, which sourced it from Mill Y. Similarly, if a report shows unexpected revenue numbers, data lineage helps you trace back through aggregations, joins, filters, and the original database tables to find where things went wrong.

Why It Matters

After performing all your validation checks (schema, completeness, consistency), data lineage ensures traceability. When stakeholders question a metric, when auditors require proof, or when bugs appear in production, lineage documentation answers "How did we get here?"

It's especially critical when:

  • Multiple transformations are chained together
  • Data flows through several tools or scripts
  • Multiple team members work on different pipeline stages
  • You need to reproduce results months later

Data lineage can be as simple as comments in your code explaining transformations, or as sophisticated as automated tracking systems that log every operation.

Key Takeaway: Data lineage maps the complete path data travels from source to destination, documenting all transformations along the way—essential for debugging, auditing, and understanding your data workflows.