1. A method for modeling a scene, the method comprising: receiving, by a computer system, a plurality of images of the scene captured over a period of time, each image comprising a plurality of pixels; creating, by the computer system, a plurality of background models using the plurality of images, wherein at least one background model is created for each pixel of the plurality of pixels; creating, by the computer system, a plurality of foreground models using the plurality of images, wherein a foreground model is created for each pixel of at least a first subset of pixels of the plurality of pixels, wherein the plurality of background models and the plurality of foreground models are indicative of the scene over the period of time; determining, by the computer system, a second subset of the plurality of pixels at least partially based on the plurality of background models and the plurality of foreground models, wherein the second subset of the plurality of pixels contains only some of the plurality of pixels, and the determining the second subset of the plurality of pixels comprises, for a pixel having a foreground model and a background model, determining: if a probability the pixel is likely to be background is greater than a first threshold value based on the background model for that pixel, and if a probability the pixel is likely to be foreground is greater than a second threshold value based on the foreground model for that pixel; determining, by the computer system, that the second subset of the plurality of pixels is representative of at least a portion of a control object; and controlling, by the computer system, an application based upon a detected movement of the control object.