source · paper
Algorithmic Progress in Language Models
src_epoch_algorithmic_progress
reliability 0.85
authors: Anson Ho, Tamay Besiroglu, Ege Erdil, David Owen, Robi Rahman, Zifan Carl Guo, David Atkinson, Neil Thompson, Jaime Sevilla
published: 2024-03
Notes
Peer-reviewed methodology; conclusions depend on benchmark selection.
Warrants from this source (1)
- weight0.85
method: modeled_projection · locator: Abstract; headline finding
“compute required to reach a set performance threshold has halved approximately every 8 months”