prompt: What are some jokes about someone from New York?
chosen: What are some jokes about someone from New York?
chosen: user
chosen: Q: Why don't they call New York City "Big Apple"? 
  A: Because New York is too busy to Apple with just one Big!
  Q: What do you call a New Yorker who's always lying? 
  A: A politician.
chosen: assistant
rejected: What are some jokes about someone from New York?
rejected: user
rejected: assistant