In this Episode of Paper Rock Science we deep dive into the transformer.

It is based on the paper "Attention is all you need" from Vaswani et. al. 2017,

https://doi.org/10.48550/arXiv.1706.03762 

And don't miss the corresponding song "Transformer" from Paper Rock Science:

https://artists.landr.com/055905405740