@inproceedings{
ivanitskiy2023linearly,
title={Linearly Structured World Representations in Maze-Solving Transformers},
author={Michael Ivanitskiy and Alexander F Spies and Tilman R{\"a}uker and Guillaume Corlouer and Christopher Mathwin and Lucia Quirke and Can Rager and Rusheb Shah and Dan Valentine and Cecilia Diniz Behn and Katsumi Inoue and Samy Wu Fung},
booktitle={UniReps:  the First Workshop on Unifying Representations in Neural Models},
year={2023},
url={https://openreview.net/forum?id=pZakRK1QHU}
}
The emergence of seemingly similar representations across tasks and neural architectures suggests that convergent properties may underlie sophisticated behavior. One form of representation that seems particularly fundamental to reasoning in many artificial (and perhaps natural) networks is the formation of world models, which decompose observed task structures into re-usable perceptual primitives and task-relevant relations. In this work, we show that auto-regressive transformers tasked with solving mazes learn to linearly represent the structure of mazes, and that the formation of these representations coincides with a sharp increase in generalization performance. Furthermore, we find preliminary evidence for Adjacency Heads which may play a role in computing valid paths through mazes.
Linearly Structured World Representations in Maze-Solving Transformers
Michael Ivanitskiy Alexander F Spies Tilman Räuker Guillaume Corlouer Christopher Mathwin Lucia Quirke Can Rager Rusheb Shah Dan Valentine Cecilia Diniz Behn Katsumi Inoue Samy Wu Fung