1. A target object detection device for detecting a target object included in a moving image captured, the target object detection device comprising: a storage section for storing (i) a plurality of pieces of detective characteristic information that is information for detecting the target object and also is information including color information and edge information and characterizing the target object and (ii) one or more pieces of detective common characteristic information that is common to all or a part of the plurality of pieces of detective characteristic information; image obtaining means for obtaining a frame image in the moving image; detective characteristic extracting means for extracting detective characteristic information from the frame image obtained by the image obtaining means; candidate area searching means for searching a candidate area, which is smaller than the frame image and has detective characteristic information similar to the detective common characteristic information, as an area where it is possible that the target object is present in the frame image, the candidate area searching means searching the candidate area by use of the detective characteristic information extracted by the detective characteristic extracting means and the detective common characteristic information in the storage section; similarity level calculating means for calculating a similarity level of the detective characteristic information included only in the candidate area searched by the candidate area searching means and the detective characteristic information in the storage section; and determination means for determining that the candidate area is an area where the target object is present in the frame image, if the similarity level calculated by the similarity level calculating means exceeds a threshold.