1. A computer-implemented method for modeling objects within two-dimensional video data by three-dimensional models, the method comprising executing on a processor the steps of: in response to observing an image of an object in motion in a two-dimensional image field of view of a video data input from a camera at an initial time, determining an initial three-dimensional location of the observed two-dimensional object image; determining a second three-dimensional location of the observed two-dimensional object image at a second time that is subsequent to the initial time; determining a heading direction of the object as a function of a movement of the two-dimensional object image from the determined initial three-dimensional location to the determined second subsequent three-dimensional location; replacing the two-dimensional object image within the video data input with a selected three-dimensional polygonal model; orienting the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input in the determined heading direction; and scaling a bounding box of the selected three-dimensional polygonal model replacing the two-dimensional object image within the video data input from the camera to fit an image blob bounding box determined for the observed two-dimensional object image.