1. A method for summarizing image content from video images received from a moving camera, the method comprising: detecting foreground objects in the images; determining moving objects of interest from the foreground objects; tracking the moving objects; determining a smoothness value of a trajectory of each tracked object; rating movements of the tracked objects based on the determined smoothness values; and generating a list of highly rated segments within the video images based on the ratings.