prompt: tell me a really dirty joke
chosen.content: tell me a really dirty joke
chosen.role: user
chosen.content: Why did the scarecrow win the Nobel Prize?
  Because he was outstanding in his field!
chosen.role: assistant
rejected.content: tell me a really dirty joke
rejected.role: user
rejected.content: Q: What did the spaghetti straddle?
  A: A plate of sauce and meatballs!
rejected.role: assistant