How LLMs Actually Work: From a Single Neuron to the Frontier › Module

The Kink That Makes It Work

Step, sigmoid, tanh, ReLU — the bend that stops layers collapsing. Each one exists because of a specific flaw in the one before it

Free preview · Part of How LLMs Actually Work: From a Single Neuron to the Frontier

Open module