ListOps [1]}, subejct-verb agreement [2]}, and logical inference [3]}, were designed to test hierarchical reasoning in tree induction models. [4]} evaluate Transformer and LSTM on the latter two tasks, suggesting the importance of recurrence in modeling hierarchical structure. These studies evaluate models on tasks requiring reasoning about single parse trees at a time. Our proposed work examines relational reasoning with multiple hierarchies, and is the first to do so (to the best of our knowledge).
