1. A composition determination device comprising: circuitry configured to: detect a face of a specific subject in a rectangular image based on image data; detect a rotation angle of the face in an image section in the rectangular image, corresponding to a detected subject which is the subject detected by the circuitry; determine if the face is facing either front, right or left as viewed in the rectangular image based on the rotation angle; and determine a composition in the rectangular image comprising horizontal sides and vertical sides on the basis of the rotation angle and on the basis of an image area division line, the image area division line being set in a vertical direction with respect to the rectangular image in response to a determination that the detected rotation angle of the face is within a predetermined angle range, wherein, (1) when the circuitry determines the face is facing either right or left as viewed in the rectangular image, the circuitry is configured to: set the image area division line with respect to the rectangular image, and calculate a movement amount on the basis of the rotation angle and on the basis of the image area division line being set in the vertical direction by dividing a size of the rectangular image in a horizontal direction by a predetermined integer, wherein, (2) when the circuitry determines the face is facing front as viewed in the rectangular image, the circuitry is configured to: detect a face rotation angle of the face; calculate the movement amount to be zero, when the face rotation angle is determined to be within a range of an upright state; and calculate the movement amount on the basis of the face rotation angle and on the basis of the image area division line being set in the vertical direction by dividing a size of the rectangular image in a horizontal direction by a predetermined integer, when the face rotation angle is determined to be not within the range of the upright state, and wherein the circuitry is configured to obtain as a determination result the composition in which a center of gravity, which is set in the image section which includes at least one detected subject, is located in a position which is shifted from the image area division line by the movement amount.