Scene graphs serve as the observational information for the sensemaking subsystem. Though there are existing scene graph generation models, the current system leverages the Visual Genome dataset, a large repository of human-made scene graphs. Visual Genome is a dataset of 108,077 images with four types of human annotations: region descriptions, attributes (e.g. color, size), relationships, and question-answer pairs [1]}. The region descriptions and relationships form scene graphs for each image, which are passed as input to the sensemaking subsystem.
