IS SC+TIS RSC (TIS) SC (w/o IS) RSC (w/o IS)
Five logit gradient coefficients versus token probability ratio The vertical axis is the selected-action logit derivative ∂w/∂z_a divided by 1−πθ(a|h), with A=1 and uncapped reverse KL. Change the KL strength and TIS cap. Move, tap, or use the arrow keys to compare the five curves at the same positive ratio.

Drag a rectangle inside the plot to zoom; Reset view restores the axes. Hover or tap to compare, use ← → to inspect, and Esc to reset the view.