How LLMs Actually Work: From a Single Neuron to the Frontier › Module

Scaled Dot-Product Attention

The summit. One equation, four symbols, computed by hand — including exactly why we divide by the square root of the key dimension, and how the causal mask stops the model peeking

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier

Open module