1. A tracking apparatus comprising: a group setting circuit which groups a plurality of focus detection areas in image data including a tracking target; a feature detection circuit which detects a feature amount of the tracking target in areas of one or more of the plurality groups grouped by the group setting circuit; a tracking circuit which: sets the focus detection area focused on the tracking target as a first tracking position, sets an area having the feature amount detected by the feature detection circuit as a second tracking position, performs a priority tracking position determination to set the first tracking position or the second tracking position as a priority tracking position based on the number of groups set by the group setting circuit, and tracks the tracking target in accordance with the first or second tracking position based on the priority tracking position determination; a display circuit which displays an image based on the image data and a tracking frame indicative of a position of the tracking target; and a control circuit which provides, when the image data is recorded as a still image, an instruction not to display the tracking frame after an instruction for still image photography and thereafter records a still image file based on the image data in a recording medium together with a position of the tracking target, and records, when the image data is recorded as a moving image, a moving image file based on the image data in a recording medium, successively records a position of the tracking target in a recording medium, and provides an instruction not to display the tracking frame after an instruction to end moving image photography.