prompt: Do you know a good Cuban joke?
chosen: Do you know a good Cuban joke?
chosen: user
chosen: Why did the chicken cross the road? To get to the other side. Offer it a reward and it will do almost anything!
chosen: assistant
rejected: Do you know a good Cuban joke?
rejected: user
rejected: assistant