1. A defect review system moving a specimen to a coordinate position of a defect detected in a first coordinate system and observing the defect of the specimen in a narrow field of view with respect to a second coordinate system, comprising: a displacement measurement section which measures an amount of displacement between the coordinate position of the defect in the first coordinate system and an actual specimen position in the second coordinate system; a coordinate correction formula optimizer which optimizes a coordinate correction formula for performing conversion from the second coordinate system to the first coordinate system in a direction of minimizing the measured amount of displacement; a variation amount calculator which performs statistical processing on a variation amount of the amount of displacement between the first coordinate system and the second coordinate system; a variation amount evaluation section which evaluates the variation amount on the basis of the length of the narrow field of view; and a sequence determining section which determines a sequence of a process of acquiring a defect image on the basis of an evaluation result by the variation amount evaluation section.