1. A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events, comprising: a. searching the photo collection to identify individuals in the photo collection, and determining the gender and age range of the identified individuals; and b. using the identified individuals, their occurrences and co-occurrences, their gender, and their ages to infer social relationships between the individuals based on a set of rules.