1. A method in a system for generating a three-dimensional face representation having at least one processor coupled to a memory, comprising: finding a face image in a two-dimensional image obtained from an image capture device using the processor and a two-dimensional face model built from a two-dimensional training set stored in the memory, wherein finding the face image comprises iteratively estimating a face image location based on an initial estimate of the face image location and a new estimate of a location of one of a plurality of model feature annotations; and using a three-dimensional face model built from a three-dimensional training set stored in the memory to generate the three-dimensional face representation from the face image.