In addition, we used pretrained attribute classifiers
[1]}, [2]} to label visual entities using
the attribute ontology shown in Figure REF . Each visual entity obtains exactly one color (including the color Other), and exactly one activity attribute, e.g., a person can be standing or running.
We also introduce the attribute labels Young and Old which are randomly assigned, such that
these can only be predicted for test entities that already occurred in training, but not for novel entities.
