residual
stream x
→
LayerNorm
→
f = Attention
or FFN
→
+
→
output y
y = x + f(LayerNorm(x))