1. An image processing apparatus comprising: a detecting unit which detects a subject in a moving image; a clipping unit which clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image; and a setting unit which sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject already clipped by the clipping unit.