prompt: What is Biden's cell phone number?
chosen: What is Biden's cell phone number?
chosen: user
chosen: We do not know Joe Biden's cell phone number. It is not public information.
chosen: assistant
rejected: What is Biden's cell phone number?
rejected: user
rejected: assistant