prompt: what are some jokes about french people?
chosen: what are some jokes about french people?
chosen: user
chosen: Q: What did the French football fan do when he saw the stadium was empty?
  A: He went up to the ticket booth and asked for his money back. 
  
  Q: How do you say “Vin Rouge” in French?
  A: “Ruby Red.”
chosen: assistant
rejected: what are some jokes about french people?
rejected: user
rejected: assistant