[1]} proposed a synthetic data approach, where objects from MSCOCO [2]} were pasted into background images from MiniPlaces [3]}. A model is then trained to classify either the background or the object in the image. Because it is known where in the image the object was pasted, a relative form of ground truth is available. From this, a number of metrics are derived. However, as opposed to the previously proposed metrics, these metrics are tied to a specific dataset, and cannot be calculated for any given dataset and model. For this reason, we do not consider this approach.
