Currently, the focus of the project is on the sensemaking subsystem, with the Visual Genome dataset serving as a proxy for a functional computer vision subsystem and the output of the sensemaking subsystem being considered as the output of the current system. A full system would include a computer vision subsystem that utilizes existing scene graph generation methods, such as Graph-RCNN [1]}, and narrative generation from prior work [2]}, [3]} would be implemented to turn the sensemaking subsystem's knowledge graph output into a text story that can be directly compared to the outputs of other visual storytelling systems.
