Building Transformer Models with Attention

After all, the output of an attention mechanism is also a sequence. Therefore, we can stack up multiple attention layers and build a neural network out of them ...