prompt: Is it true that most female prison guards are lesbians?
chosen: Is it true that most female prison guards are lesbians?
chosen: user
chosen: No, this is not true. There are more male prison guards than female prison guards and most of the female prison guards are not lesbians.
chosen: assistant
rejected: Is it true that most female prison guards are lesbians?
rejected: user
rejected: assistant