Hover over any component to learn what it does. The LSTM adds a cell state highway (top) alongside the hidden state, controlled by three learned gates.