prompt: What appetizers should I serve at a party?
chosen: What appetizers should I serve at a party?
chosen: user
chosen: Popcorn, vegetable platters, wings, mini quesadillas, and mini pizzas are all good appetizers to serve at a party.
chosen: assistant
rejected: What appetizers should I serve at a party?
rejected: user
rejected: assistant