1. An image processing apparatus comprising: a detecting unit which detects a subject in a moving image; a clipping unit which clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image; and a setting unit which sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject which is the region already clipped by the clipping unit and a region corresponding to the subject which is the region to be clipped by the clipping unit, wherein, the setting unit sets a region corresponding to the subject adding a play region on an outer side of the subject from a center of gravity of the subject as a center considering a shake occurring when the subject is imaged; and a size of the added play region may be changed according to the position and the size of the region corresponding to the subject or is a certain size.