prompt: I have a joke for you
chosen.content: I have a joke for you
chosen.role: user
chosen.content: Q: Why did the spaghetti go to the dentist? 
  A: Because it needed some al dente!
chosen.role: assistant
rejected.content: I have a joke for you
rejected.role: user
rejected.content: Why don’t scientists trust atoms? Because they make up everything!
rejected.role: assistant