X
n × d
→
Q = XW
Q
· n × d
k
K = XW
K
· n × d
k
V = XW
V
· n × d
v
→
QK
T
/ √d
k
n × n
→
A
row softmax · n × n
→
AV
weighted values
→
Z
n × d
v