Baseline Subtraction and Variance Reduction

See how subtracting a baseline (value function) from returns reduces gradient variance without introducing bias.