How LLMs Actually Work: From a Single Neuron to the Frontier › Module
Prefill saturates the GPU, decode barely uses it. This one distinction explains time-to-first-token, why batching works, and what you are actually paying for
Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier