1. A computer program product for summarizing image content from video images received from a moving camera, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by a processor, to perform method steps comprising: detecting foreground objects in the images; determining moving objects of interest from the foreground objects; tracking the moving objects; rating movements of the tracked objects; and generating a list of highly rated segments within the video images based on the ratings.