Scaling laws
AIScaling laws: The empirical finding that model loss falls predictably as a power of model size, data and compute, which is what justified ever-larger training runs.
Scaling laws: The empirical finding that model loss falls predictably as a power of model size, data and compute, which is what justified ever-larger training runs.