1. A tracked object determination device, comprising a unit which determines whether a moving object is tracked or not by a cameraman based on a time difference between time when a movement state determined by a motion vector of the moving object changes and time when a shooting state determined by a motion vector of a camera motion changes.