How LLMs Actually Work: From a Single Neuron to the Frontier › Module

The Shortcut That Replaced PPO

If the optimal policy and the reward model are two views of the same thing, you can cancel the reward model out. Three models and a fragile loop become one ordinary training run

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier

Open module