1. A method of adjusting in a charged particle beam apparatus constructed to irradiate a charged particle beam on a sample to scan said sample, detect charged particles obtained by said irradiation, create an image of a region over which said sample is scanned on the basis of said detected charged particles, and control the focus of said charged particle beam and the brightness of said image and/or contrast of said image on the basis of said created image, said method comprising the steps of: creating a matching pattern when said charged particle beam is irradiated on said sample to scan a matching pattern of said sample; controlling the focus of said charged particle beam and the brightness of said image and/or contrast of said image on the basis of said image of said matching pattern on the basis of an irradiation of said charged particle beam on said sample to scan said sample; performing an alignment to scan of said charged particle beam, on the basis of said image of said matching pattern which has the controlled focus of said charged particle beam and the controlled brightness of said image and/or the controlled contrast of said image; and irradiating said charged particle beam on said sample to scan a measuring pattern, wherein a position of said measuring pattern is identified by said matching pattern by using control conditions of said charged particle beam which has the controlled focus of said charged particle beam and the controlled brightness of said image and/or the controlled contrast of said image.