A review of single-source unsupervised domain adaptation <s> Search space shrinkage <s> General intelligence (g) poses a problem for evolutionary psychology’s modular view of the human brain. The author advances a new evolutionary psychological theory of the evolution of general intelligence and argues that general intelligence evolved as a domain-specific adaptation for the originally limited sphere of evolutionary novelty in the ancestral environment. It has accidentally become universally important merely because we now live in an evolutionarily novel world. The available data seem to support the author’s contention that intelligent people can solve problems better than less intelligent people only if the problems are evolutionarily novel, and they have no advantage in solving evolutionarily familiar problems. This perspective can also solve some empirical anomalies, such as the “central theoretical problem of human sociobiology” (D. R. Vining, 1986, p. 167) and the geographic distribution of general intelligence throughout the world. The g factor is actually a biologically based variable, which, like other biological functions in the human species, is necessarily a product of the evolutionary process. (Jensen, 1998, p. xii) The existence of the g factor (the “general intelligence” factor) in psychometrics appears to contradict the strong modularity view of the mind. (Miller, 2000, p. 42) Larry King: What, Professor, puzzles you the most? What do you think about the most? <s> BIB001 </s> A review of single-source unsupervised domain adaptation <s> Search space shrinkage <s> The explosion of image data on the Internet has the potential to foster more sophisticated and robust models and algorithms to index, retrieve, organize and interact with images and multimedia data. But exactly how such data can be harnessed and organized remains a critical problem. We introduce here a new database called “ImageNet”, a large-scale ontology of images built upon the backbone of the WordNet structure. ImageNet aims to populate the majority of the 80,000 synsets of WordNet with an average of 500-1000 clean and full resolution images. This will result in tens of millions of annotated images organized by the semantic hierarchy of WordNet. This paper offers a detailed analysis of ImageNet in its current state: 12 subtrees with 5247 synsets and 3.2 million images in total. We show that ImageNet is much larger in scale and diversity and much more accurate than the current image datasets. Constructing such a large-scale database is a challenging task. We describe the data collection scheme with Amazon Mechanical Turk. Lastly, we illustrate the usefulness of ImageNet through three simple applications in object recognition, image classification and automatic object clustering. We hope that the scale, accuracy, diversity and hierarchical structure of ImageNet can offer unparalleled opportunities to researchers in the computer vision community and beyond. <s> BIB002
In a number of methods the source domain is a means of narrowing the search space. For example, Empirical Bayes approaches fit the prior distribution on data from a source domain. This informed prior assigns low probabilities to parameters that would not be suitable for the current task. Hence, the search space is effectively smaller than the noninformative flat prior. Another example is fine-tuning in deep neural networks. A neural network is first trained on a large generic data set such as ImageNet BIB002 and then trained on the smaller data set of your current problem. Instead of starting from scratch, pre-training already provides sensible parameters  . During the second phase of training, the network does not need to evaluate the loss of the randomly initialized parameters. Ignoring sets of parameters that have not been relevant in similar tasks is an intuitive notion of how the source domain assists the learning process. One immediately understands why it could be dangerous as well. If the source domain informs the classifier to ignore parameters that are actually useful for the target domain, then it interferes with learning. This interpretation shows an interesting link to natural intelligence, where agents use knowledge from previous tasks to complete new tasks BIB001 .