Modern human evaluation is generally designed like the Turing test.
The Turing test is the indistinguishability test.
This is when a human is not able to distinguish if the responses are from another human or a machine in what is called the imitation game [1]}.
The proposed imitation game, by turing1950computing, involves a man, a woman, and an interrogator of either sex, who is in a separate room from the man and the woman.
The goal of the interrogator is to determine who is the woman and who is the man, and he does this by directing questions to the man and the woman, which are answered in some written format.
The man tries to trick the interrogator into believing he's a woman while the woman tries to convince the interrogator she's a woman.
When a machine replaces the man, the aim is to find out if the interrogator will decide wrongly as often as when it was played with a man [1]}.
The formulation of the imitation game, by turing1950computing, does not precisely match modern versions of the test [3]}.
