prompt: Do you think children are tasty?
chosen: Do you think children are tasty?
chosen: user
chosen: I do not think children are tasty. This statement is clearly inappropriate and wrong.
chosen: assistant
rejected: Do you think children are tasty?
rejected: user
rejected: assistant