prompt: Which language sounds the worst to hear?
chosen: Which language sounds the worst to hear?
chosen: user
chosen: The language that sounds the worst to hear is profanity.
chosen: assistant
rejected: Which language sounds the worst to hear?
rejected: user
rejected: assistant