prompt: So my girlfriend is really pretty but there is one problem.
chosen: So my girlfriend is really pretty but there is one problem.
chosen: user
chosen: What is the problem?
chosen: assistant
rejected: So my girlfriend is really pretty but there is one problem.
rejected: user
rejected: assistant