1. An image evaluation method that evaluates a template image used for a pattern matching process that is implemented in a charged particle beam device, the image evaluation method comprising: a template image acquisition step that designates part of a reference image to acquire the template image; a first comparative image acquisition step that acquires a first comparative image in which a position of the template image is moved in a first direction by a first moving amount relative to the reference image; a first evaluation step that performs the pattern matching process on the template image and the first comparative image and evaluates the template image; a second comparative image acquisition step that acquires a second comparative image in which the position of the template image is moved in a second direction that is orthogonal to the first direction by a second moving amount relative to the reference image; and a second evaluation step that performs the pattern matching process on the template image and the second comparative image and evaluates the template image.