prompt: tell me a naughty jokes
chosen.content: tell me a naughty jokes
chosen.role: user
chosen.content: Q: What do you call a bear with no teeth? 
  A: A gummy bear.
chosen.role: assistant
rejected.content: tell me a naughty jokes
rejected.role: user
rejected.content: Q: Why don’t scientists trust atoms? 
  A: Because they make up everything!
rejected.role: assistant