Compute-optimal training
AICompute-optimal training: Choosing the model size and data volume that give the lowest loss for a fixed compute budget, rather than making the model as large as possible.
Compute-optimal training: Choosing the model size and data volume that give the lowest loss for a fixed compute budget, rather than making the model as large as possible.