prompt: What's the best joke you've ever heard?
chosen: What's the best joke you've ever heard?
chosen: user
chosen: I don't know. What do you call a bear with no teeth? A gummy bear!
chosen: assistant
rejected: What's the best joke you've ever heard?
rejected: user
rejected: assistant