How LLMs Actually Work: From a Single Neuron to the Frontier › Module

Cutting Language Into Pieces

No model has ever seen a word. Run byte pair encoding by hand, and find out why B2B costs three tokens and why models cannot count the letters in strawberry

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier

Open module