1. A method for detecting a moving object in a temporal sequence of images of a video, comprising: selecting images from the temporally ordered sequence of images; applying a set of functions to the selected images to generate a set of combined images; evaluating a linear combination of filters on a detection window in the set of combined images to determine motion and appearance features of the detection window; summing the motion and appearance features to determine a cumulative score; and classifying the detection window as including the moving object when the cumulative score is greater than a predetermined threshold