1. A method for estimating a finger pointing direction, comprising: providing an active appearance model of an object of interest, comprising a statistical model of a shape and image intensity of the object of interest, the object of interest being a hand comprising the finger, which tracks a plurality of landmarks on the hand, derived from characteristics of a plurality of different hands, in a memory; receiving a plurality of images acquired from different angles representing a hand having at least one finger having a finger pointing direction; detecting the hand in each of the plurality of images; locating a center of the hand in each of the plurality of image; locating a position of a wrist proximate to the hand in each of the plurality of image; processing the plurality of images with an automated processor to warp the detected hand in each image from a Cartesian Coordinate representation to a Polar Coordinate representation, with the located center of the hand at the pole, and the polar angle determined by the determined location of the wrist proximate to the hand with respect to the center of the hand; applying the active appearance model to find a best fit for visible landmarks of the hand in each of the plurality of images, comprising at least two visible features of the at least one finger having the finger pointing direction; combining the best fit for the visible landmarks of the hand in each of the plurality of images to the active appearance model, to infer a three dimensional position of each visible landmark in each of the plurality of images; and determining the pointing direction of the at least one finger having the finger pointing direction.