The Power Family w = ρq — Bias-Variance Tradeoff

Left: weight function w(ρ). Right: simulated gradient variance across mini-batches. Drag q to interpolate between no correction and full IS.

0.50
0.50