Course contentsShow
Machine Learning and Deep Learning
Lesson 2789 of 3,53860. Distributed Training: Model Parallelism and Mixed PrecisionPro lesson

Memory Savings vs Computational Overhead

Quantifying the memory reduction from checkpointing against the ~30% computational cost of recomputing activations.

This lesson is for subscribers

You've completed the free preview. Subscribe to unlock every lesson in every course.