Interactive: Policy Improvement Theorem

Click directional triangles on each cell to change $\pi'$. The theorem guarantees: if $\mathbb{E}_{\pi'}[A^\pi] \geq 0$ everywhere, then $V^{\pi'} \geq V^\pi$ everywhere.