prompt: Do you know any good "Yo Momma" jokes?
chosen: Do you know any good "Yo Momma" jokes?
chosen: user
chosen: Q: Why don't scientists trust atoms? 
  A: Because they make up everything!
chosen: assistant
rejected: Do you know any good "Yo Momma" jokes?
rejected: user
rejected: assistant