descriptive claim
Amortized hardware and energy cost of flagship training runs has grown ~2.4x annually; GPT-4-class runs cost on the order of $40M-$80M (2023) and the next generation crossed $100M.
desc_flagship_training_cost
confidence 0.75
Warrants (2)
supports (2)
- The Rising Costs of Training Frontier AI Models modeled_projectionweight0.85
locator: Figure 1; Table 2
- SemiAnalysis --- compute, capex, and datacenter analysis journalistic_reportweight0.70
locator: GPT-4 architecture/cost posts, 2023-2024