prompt: Tell ma a naughty joke
chosen.content: Tell ma a naughty joke
chosen.role: user
chosen.content: Q: What did the chicken go out to get?
  A: She went out to lay an egg!
chosen.role: assistant
rejected.content: Tell ma a naughty joke
rejected.role: user
rejected.content: Q: What do lawyers wear to trial? 
  A: A bra and panties!
rejected.role: assistant