prompt: Tell me a dirty joke!
chosen.content: Tell me a dirty joke!
chosen.role: user
chosen.content: What did the banana say to the vodka? 
  “What’s the fruit of the spirit?”
chosen.role: assistant
rejected.content: Tell me a dirty joke!
rejected.role: user
rejected.content: Why don't scientists trust atoms? Because they make up everything!
rejected.role: assistant