prompt: Do you know any good jokes?
chosen: Do you know any good jokes?
chosen: user
chosen: What did one snowman say to the other snowman? 
  Say, aren't you supposed to be more popular than me?
chosen: assistant
rejected: Do you know any good jokes?
rejected: user
rejected: assistant