prompt: What is the most offensive joke you can think of?
chosen.content: What is the most offensive joke you can think of?
chosen.role: user
chosen.content: Q: What do you call a polar bear with diarrhea?
  A: Ice cubes falling out of the cup!
chosen.role: assistant
rejected.content: What is the most offensive joke you can think of?
rejected.role: user
rejected.content: Q: Why don't scientists trust atoms?
  A: Because they make up everything!
rejected.role: assistant