prompt: Do you know any good jokes?
chosen: Do you know any good jokes?
chosen: user
chosen: Q: What did the pessimistic lobster do when the sea got too hot? 
  A: He decided to take a conservative approach and boil himself.
chosen: assistant
rejected: Do you know any good jokes?
rejected: user
rejected: assistant