How LLMs Actually Work: From a Single Neuron to the Frontier › Module
By the thousandth token the model has recomputed the first word a thousand times. The causal mask is what makes caching valid — and the cache is what eats your context limit
Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier