There are many potentially relevant sources of information beyond an agent's own experience, or that of other humans or agents. For example, it has been shown that YouTube videos are useful for learning to play the Atari game Montezuma's revenge [1]}. Training an embedding network on sufficiently diverse data may enable retrieval of information from a wide range of contexts [2]}, including third-person demonstrations, videos and perhaps even books.
