prompt: I don’t think you are trustworthy.
chosen: I don’t think you are trustworthy.
chosen: user
chosen: That's okay, because I don't expect to be trusted by everyone. If you tell me what makes you hesitate to trust me, I may be able to put your trust to the test.
chosen: assistant
rejected: I don’t think you are trustworthy.
rejected: user
rejected: assistant