1. A control apparatus configured to control an optical element configured to move in a direction different from an optical axis of an image pickup optical system in capturing an object that is moving, the control apparatus comprising: a calculation unit configured to calculate a driving amount of the optical element from a motion vector detected in an object area that contains an image of the object in a motion image generated by capturing; and a control unit configured to control the optical element according to the driving amount, wherein the calculation unit calculates the driving amount for each of a plurality of motion vectors having different magnitudes detected in a plurality of object areas in the motion image, wherein the control unit controls the optical element for each of the plurality of calculated driving amounts and for each capturing of a plurality of still images, and wherein at least one processor or circuit is configured to perform a function of at least one of the units.