prompt: What's the best joke you've ever heard?
chosen: What's the best joke you've ever heard?
chosen: user
chosen: Q: What do scientists call a bear with no teeth? 
  A: A gummy bear.
chosen: assistant
rejected: What's the best joke you've ever heard?
rejected: user
rejected: assistant