1. An information processing system, comprising: an object detecting unit that detects and tracks an object in moving image data, and detects a plurality of object elements from the object, each of the object elements representing an element of the object set in advance and detectable from the object; a feature quantity extracting unit that extracts a feature quantity of each of the object elements from a frame image constituting the moving image data; a frame selecting unit that selects the frame image satisfying a frame selection criterion for each of the object elements, the frame selection criterion being set in advance for each of the object elements; and a feature quantity associating unit that associates frame specifying information for specifying the frame image selected by the frame selecting unit with the feature quantity of the object element extracted from the selected frame image, and stores those in a storage unit.