Notes

This is a rough collection of notes on various technical topics, inspired by Victor Lecomte’s notes. These notes will always be incomplete, and a work in progress. Additionally, many of these notes are just my reformulation of existing work - see the “Sources” section in each note to see the original source of the material.

Probability

• Concentration inequalities

AI / ML

• Attention

• Kernels

• Layer normalization