This work focuses on active learning of distance metrics from relative comparison information. A relative comparison specifies, for a data point triplet @math , that instance @math is more similar to @math than to @math . Such constraints, when available, have been shown to be useful toward defining appropriate distance metrics. In real-world applications, acquiring constraints often require considerable human effort. This motivates us to study how to select and query the most useful relative comparisons to achieve effective metric learning with minimum user effort. Given an underlying class concept that is employed by the user to provide such constraints, we present an information-theoretic criterion that selects the triplet whose answer leads to the highest expected gain in information about the classes of a set of examples. Directly applying the proposed criterion requires examining @math triplets with @math instances, which is prohibitive even for datasets of moderate size. We show that a randomized selection strategy can be used to reduce the selection pool from @math to @math , allowing us to scale up to larger-size problems. Experiments show that the proposed method consistently outperforms two baseline policies.
proposed one of the first formal approaches for distance metric learning with side information @cite_12 . In this study, they considered pairwise information indicating whether two instances are similar or dissimilar. A distance metric is learned by minimizing the distances between the instances in the similar pairs while keeping the distances between dissimilar pairs large.
@cite_12
2117154949
Many algorithms rely critically on being given a good metric over their inputs. For instance, data can often be clustered in many "plausible" ways, and if a clustering algorithm such as K-means initially fails to find one that is meaningful to a user, the only recourse may be for the user to manually tweak the metric until sufficiently good clusters are found. For these and other applications requiring good metrics, it is desirable that we provide a more systematic way for users to indicate what they consider "similar." For instance, we may ask them to provide examples. In this paper, we present an algorithm that, given examples of similar (and, if desired, dissimilar) pairs of points in ℝn, learns a distance metric over ℝn that respects these relationships. Our method is based on posing metric learning as a convex optimization problem, which allows us to give efficient, local-optima-free algorithms. We also demonstrate empirically that the learned metrics can be used to significantly improve clustering performance.