Transformers

Sources

• Attention Is All You Need - Vaswani et al., 2017
• A Mathematical Framework for Transformer Circuits - Elhage et al., 2021
• The Annotated Transformer - Huang et al., 2022
• An Analogy for Understanding Transformers - Callum McDougall, 2023