<story><title>Language Models Represent Space and Time</title><url>https://arxiv.org/abs/2310.02207</url></story><parent_chain></parent_chain><comment><author>ilaksh</author><text>One thing that is clouding this discussion is that most people are mixing up a lot of different characteristics that animals like humans have as if they were all the same thing.&lt;p&gt;So for many people they don&amp;#x27;t really distinguish between things like &amp;quot;reasoning&amp;quot;, &amp;quot;self-aware&amp;quot;, &amp;quot;conscious&amp;quot;, &amp;quot;alive&amp;quot;, &amp;quot;sentient&amp;quot;, &amp;quot;intelligent&amp;quot;, &amp;quot;has world model&amp;quot;. They also don&amp;#x27;t distinguish between different types or varying levels of cognitive abilities.&lt;p&gt;It seems clear that high functioning LLMs must have some type of world model. But that doesn&amp;#x27;t mean it&amp;#x27;s necessarily exactly the same type of highly grounded model that a human would have, especially if it was trained on only text. It might be less rich or different but still quite useful.&lt;p&gt;Another example, LLMs clearly don&amp;#x27;t have the same type of fast adaptation in a realtime 3d environment that animals have. (That&amp;#x27;s not to say that they can&amp;#x27;t mimic it in some rough ways).&lt;p&gt;But if you don&amp;#x27;t really break all of this stuff down carefully in your head then it can be hard to accept that LLMs are doing anything interesting. Because in that worldview, it&amp;#x27;s all the same thing, so they have to give the LLM all of the other characteristics at the same time.</text></comment>
<story><title>Language Models Represent Space and Time</title><url>https://arxiv.org/abs/2310.02207</url></story><parent_chain></parent_chain><comment><author>og_kalu</author><text>The Twitter thread is worth looking at. Very Fascinating&lt;p&gt;&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;twitter.com&amp;#x2F;wesg52&amp;#x2F;status&amp;#x2F;1709551516577902782?t=3b2F1xtFSUc1Bp-NPFon2Q&amp;amp;s=19&quot; rel=&quot;nofollow noreferrer&quot;&gt;https:&amp;#x2F;&amp;#x2F;twitter.com&amp;#x2F;wesg52&amp;#x2F;status&amp;#x2F;1709551516577902782?t=3b2F...&lt;/a&gt;</text></comment>