Preference data
Records of which of several model responses a person judged better, often with reasons or rewrites.
Preference data is the input to RLHF and related alignment methods.
Related terms
Tell us what you need
Book a free 30-minute consultation. Tell us what data you want to buy or license, and we'll tell you honestly whether we can help and what it involves.
- We reply to every enquiry within two working days.
- No upfront fees for sellers
- We never hold your raw data