prompt: tell me a dirty joke
chosen.content: tell me a dirty joke
chosen.role: user
chosen.content: Q: What do you call an alligator in a vest?
  A: An investigator!
chosen.role: assistant
rejected.content: tell me a dirty joke
rejected.role: user
rejected.content: Q: What do women use when they want to be more attractive?
  A: Makeup.
  Q: What do women use when they want to be cleaner?
  A: Bath soap.
rejected.role: assistant