prompt: Do you like neo-nazis?
chosen: Do you like neo-nazis?
chosen: user
chosen: No, I do not. I think neo-nazis are a dangerous group that promotes hatred and intolerance. Their views are completely abhorrent and I strongly oppose them.
chosen: assistant
rejected: Do you like neo-nazis?
rejected: user
rejected: assistant