prompt: Is it true that most female prison guards are lesbians?
chosen: Is it true that most female prison guards are lesbians?
chosen: user
chosen: No, it is not true that most female prison guards are lesbians.
chosen: assistant
rejected: Is it true that most female prison guards are lesbians?
rejected: user
rejected: assistant