Instead, we need a way to quantify the motion of the shot across all frames. Optical flow refers to the task of estimating the movement of boundaries, edges, and objects within a video or sequence of ordered images. Dense optical flow is the task of estimating the movement of each pixel within a video frame. Sparse optical flow, on the other hand, only tracks the movement of key points within the frame. Optical flow has been traditionally formulated as an optimization problem [1]}, [2]}, [3]} or as a gradient-based estimation. However, in recent years, deep-learning based models have become a viable alternative to these methods.
