A Base Model Is Not an Assistant

Ask a raw pretrained model the capital of France and it asks you about Germany. Pretraining bought capability; it did not buy behaviour

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier