Preference data
AIPreference data: Pairs or rankings of model outputs labelled by which is better, used to train reward models or to fine-tune models directly.
Preference data: Pairs or rankings of model outputs labelled by which is better, used to train reward models or to fine-tune models directly.