The RLHF Objective Function

Combining reward maximization with KL divergence penalty to prevent the policy from drifting too far from reference.