
ConceptMNIST (C-MNIST): We augment the original MNIST dataset by constructing concepts of each image by including 2 physical characteristics of numbers in the image along with 10 standard non-overlapping concepts representing one hot encodings of the number, resulting in a size 12 concept vector for each image. [Low Risk]

CUB: The Caltech-UCSD Birds-200-2011 dataset [1]} consists of photos of 200 classes of birds. Pre-processing of the dataset is performed exactly as [2]}. Final dataset consists of 112 concepts for each class with concepts representing physical traits of the birds like wing color, beak size, etc. [Low Risk]

OAI: The Osteoarthritis Initiative (OAI) dataset [3]} consists of X-ray images and clinical data for about 36,000 patients over 4 years of study who pose a risk of knee osteoarthritis. The task is X-ray grading into 4 different risk categories (KLG Score). Each image has 10 medical concepts from X-ray images such as bone spacing. For more comprehensive description, refer to [4]}. [High Risk]

