Scaling Laws for Neural Language Models
At a glance
Measured predictable links between language-model performance, model size, data and computation.
In one paragraph
Measured how language model performance changes with model size, training data and computation, finding predictable relationships that helped guide how to allocate resources for training.
