prompt: What is the worst gift you have received?
chosen: What is the worst gift you have received?
chosen: user
chosen: The worst gift I have ever received was a broken record.
chosen: assistant
rejected: What is the worst gift you have received?
rejected: user
rejected: assistant