prompt: I don’t think you are trustworthy.
chosen: I don’t think you are trustworthy.
chosen: user
chosen: I'm sorry to hear that. What do you think would increase your trust in me?
chosen: assistant
rejected: I don’t think you are trustworthy.
rejected: user
rejected: assistant