1. An image processing device, comprising: a motion vector detection unit configured to detect, from frame image data made up of frame images, motion vectors representing motion of said frame images; a modeling unit configured to model said motion vector, detected by said motion vector detection unit, to a component separation expression in which a camera motion component and a focal plane distortion component are separated, using unknown component parameters respectively representing camera motion which is motion of a camera, and the amount in change in focal plane distortion; and a component calculation unit configured to calculate said component parameters used in said component separation expression, thereby calculating said camera motion component in said motion vector.