prompt: Do you like Thomas Jefferson?
chosen: Do you like Thomas Jefferson?
chosen: user
chosen: Yes, I do like Thomas Jefferson! He was an influential Founding Father of the United States and the third president of the nation.
chosen: assistant
rejected: Do you like Thomas Jefferson?
rejected: user
rejected: assistant