1. A method of operation of an image processing system comprising: detecting edges in a first image frame and a second image frame stored by a storage device or a memory; generating edge motion vectors between the first image frame and the second image frame based on the edges; extracting dominant motion vectors from a group of the edge motion vectors; generating a motion vector list based on the dominant motion vectors; generating a segmentation of the first image frame; generating initial motion vectors based on the segmentation and the motion vector list; generating smooth motion vectors based on the initial motion vectors; and generating a dense optical flow field by combining the smooth motion vectors.