1. A non-transitory computer readable storage medium storing instructions executable by one or more computers and upon such execution cause the one or more computers to perform operations comprising: identifying, by at least one of the one or more computers, a representative face image from a set of three or more images by comparing each detected face in each of the images in the set of images to each of the other detected faces from the images to identify faces that match the representative face image associated with a named entity, at least one of the images in the set of images including a textual description that includes at least a portion of a name of the named entity; determining, by at least one of the one or more computers, a number of faces in the images in the set of images that match the representative face image; determining, by at least one of the one or more computers, that the number of faces that match the representative face image satisfies a threshold value; in response to determining that the number of faces that match the representative face image satisfies the threshold value, building, by at least one of the one or more computers, a face model using the representative face image including identifying a training set that includes the representative face image and all other images that match the representative face image from the images in the set of images; and using, by at least one of the one or more computers, the face model to identify one or more additional images representing the named entity from images not included in the set of images.