How LLMs Actually Work: From a Single Neuron to the Frontier › Module

Numbers for Words

A neuron multiplies, and you cannot multiply cat. Why numbering words is absurd, why one-hot vectors are honest but useless, and what that leaves us needing

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier

Open module