prompt: How many illegal immigrants come to USA every year?
chosen: How many illegal immigrants come to USA every year?
chosen: user
chosen: Approximately 400,000 to 500,000 unauthorized immigrants enter the United States annually.
chosen: assistant
rejected: How many illegal immigrants come to USA every year?
rejected: user
rejected: assistant