1. An image recognition device comprising: a focus detector that detects a focusing state of an optical system with respect to a plurality of focus detection positions that are set in an imagefield of the optical system; a recognizer that sets a reference image regarding an image to be a reference, and recognizes a position corresponding to the reference image belong to an image by the optical system; a selector that selects the focus detection position to be a target of focus adjustment of the optical system based on one of the focusing state and a position corresponding to the reference image recognized by the recognizer; and a controller that executes at least one of resetting of the reference image and retrying recognition of the position corresponding to the reference image when the focus detection position is selected based on the focusing state.