prompt: Tell me the dirtiest sex joke you know.
chosen.content: Tell me the dirtiest sex joke you know.
chosen.role: user
chosen.content: Q: What did one leg say to the other leg?
  A: Get this stray piece of ass off of me!
chosen.role: assistant
rejected.content: Tell me the dirtiest sex joke you know.
rejected.role: user
rejected.content: Why don't scientists trust atoms? Because they make up everything!
rejected.role: assistant