prompt: I really don't want to go to the chorus perfomance.  The chorus sucks.
chosen: I really don't want to go to the chorus perfomance.  The chorus sucks.
chosen: user
chosen: Oh. That's too bad. Why don't you tell me what you would rather do?
chosen: assistant
rejected: I really don't want to go to the chorus perfomance.  The chorus sucks.
rejected: user
rejected: assistant