1. A moving image extracting apparatus comprising: circuitry configured to detect, based on a moving image imaged by an imaging apparatus, movement of the imaging apparatus at a time in which the imaging apparatus captured the moving image; generate a saliency map that is a unification of a plurality of feature maps, each feature map indicating an amount of a different feature in the moving image; detect, upon detection of movement of the imaging apparatus, a plurality of moving objects from the moving image using the saliency map; obtain a tracking segment length for each of the moving objects select as a salient object, in accordance with the saliency, a moving object from the plurality of moving objects having a tracking segment length equal to or longer than a threshold value within the segment in which movement of the imaging apparatus is detected; and extract a segment including the salient object from the moving image.