<story><title>Using GPT-3 to pathfind in random graphs</title><url>https://jacobbrazeal.wordpress.com/2022/09/23/gpt-3-can-find-paths-up-to-7-nodes-long-in-random-graphs/</url></story><parent_chain><item><author>dwohnitmok</author><text>GPT-3 didn&amp;#x27;t even need the `gloober Blue` prompt as part of `Answer:`. It 0-shotted (no other training examples required) it straight out of the box.&lt;p&gt;Prompt:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  Every turn each gloober flomps the same gloobers. If a yellow gloober flomps a blue gloober then the blue gloober turns yellow, otherwise, gloobers stay the same color.
  
  1. gloober Roy flomps gloober Zoo and gloober Bat
  
  2. gloober Zoo flomps gloober Bat and gloober Crystal
  
  3. gloober Crystal flomps gloober X-Ray
  
  4. gloober Bat flomps gloober Blue
  
  If gloober Zoo is the only gloober that is yellow, and all other gloobers are blue, will gloober Blue turn yellow, and, if so, at what turn?
  
  Answer:
&lt;/code&gt;&lt;/pre&gt;
Continuation:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  gloober Blue will turn yellow on turn 4.
&lt;/code&gt;&lt;/pre&gt;
&amp;gt; I find it a little unsettling that GPT-3 is able to do this well.&lt;p&gt;I agree and think that this is definitely the right reaction.</text></item><item><author>ALittleLight</author><text>I find it a little unsettling that GPT-3 is able to do this well.  This kind of problem is abstract and I assume its training data doesn&amp;#x27;t extensively cover this kind of thing.  I wonder if it would work meaningfully worse if you used different words in the prompt other &amp;quot;edge&amp;quot; and &amp;quot;node&amp;quot; which are probably used in examples somewhat like this.&lt;p&gt;Example prompt -&lt;p&gt;Every turn each gloober flomps the same gloobers.  If a yellow gloober flomps a blue gloober then the blue gloober turns yellow, otherwise, gloobers stay the same color.&lt;p&gt;1. gloober Roy flomps gloober Zoo and gloober Bat&lt;p&gt;2. gloober Zoo flomps gloober Bat and gloober Crystal&lt;p&gt;3. gloober Crystal flomps gloober X-Ray&lt;p&gt;4. gloober Bat flomps gloober Blue&lt;p&gt;If gloober Zoo is the only gloober that is yellow, and all other gloobers are blue, will gloober Blue turn yellow, and, if so, at what turn?&lt;p&gt;Answer: gloober Blue</text></item></parent_chain><comment><author>nikkwong</author><text>I know that GPT-3 is not AGI nor modeled properly to ever represent what we would consider to be AGI; but this feels freakishly AGI-ish. This feels like the model is &amp;#x27;reasoning&amp;#x27; in a way that I would not expect based on my intuition of how GPT-3 works. As it&amp;#x27;s been explained to me in lay terms; GPT is great at predicting the next word based on a chunk of previous context. This feels like it&amp;#x27;s doing much more than that as it&amp;#x27;s understanding the context and parameters that relate to a question embedded in the text, which seems unrelated to the original instruction of GPT-3 as I understand. Can anyone explain?</text></comment>
<story><title>Using GPT-3 to pathfind in random graphs</title><url>https://jacobbrazeal.wordpress.com/2022/09/23/gpt-3-can-find-paths-up-to-7-nodes-long-in-random-graphs/</url></story><parent_chain><item><author>dwohnitmok</author><text>GPT-3 didn&amp;#x27;t even need the `gloober Blue` prompt as part of `Answer:`. It 0-shotted (no other training examples required) it straight out of the box.&lt;p&gt;Prompt:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  Every turn each gloober flomps the same gloobers. If a yellow gloober flomps a blue gloober then the blue gloober turns yellow, otherwise, gloobers stay the same color.
  
  1. gloober Roy flomps gloober Zoo and gloober Bat
  
  2. gloober Zoo flomps gloober Bat and gloober Crystal
  
  3. gloober Crystal flomps gloober X-Ray
  
  4. gloober Bat flomps gloober Blue
  
  If gloober Zoo is the only gloober that is yellow, and all other gloobers are blue, will gloober Blue turn yellow, and, if so, at what turn?
  
  Answer:
&lt;/code&gt;&lt;/pre&gt;
Continuation:&lt;p&gt;&lt;pre&gt;&lt;code&gt;  gloober Blue will turn yellow on turn 4.
&lt;/code&gt;&lt;/pre&gt;
&amp;gt; I find it a little unsettling that GPT-3 is able to do this well.&lt;p&gt;I agree and think that this is definitely the right reaction.</text></item><item><author>ALittleLight</author><text>I find it a little unsettling that GPT-3 is able to do this well.  This kind of problem is abstract and I assume its training data doesn&amp;#x27;t extensively cover this kind of thing.  I wonder if it would work meaningfully worse if you used different words in the prompt other &amp;quot;edge&amp;quot; and &amp;quot;node&amp;quot; which are probably used in examples somewhat like this.&lt;p&gt;Example prompt -&lt;p&gt;Every turn each gloober flomps the same gloobers.  If a yellow gloober flomps a blue gloober then the blue gloober turns yellow, otherwise, gloobers stay the same color.&lt;p&gt;1. gloober Roy flomps gloober Zoo and gloober Bat&lt;p&gt;2. gloober Zoo flomps gloober Bat and gloober Crystal&lt;p&gt;3. gloober Crystal flomps gloober X-Ray&lt;p&gt;4. gloober Bat flomps gloober Blue&lt;p&gt;If gloober Zoo is the only gloober that is yellow, and all other gloobers are blue, will gloober Blue turn yellow, and, if so, at what turn?&lt;p&gt;Answer: gloober Blue</text></item></parent_chain><comment><author>ALittleLight</author><text>I&amp;#x27;ve been messing with the prompt a little bit and tried to get it to spell out what it thinks is happening.  (I changed the name of gloober Blue to gloober Lovely just to make it easier to read).  Continuation is at the asterisk.&lt;p&gt;&lt;pre&gt;&lt;code&gt;    Every turn each gloober flomps the same gloobers. If a yellow gloober flomps a blue gloober then the blue gloober turns yellow, otherwise, gloobers stay the same color.

    1. gloober Roy flomps gloober Zoo
    2. gloober Roy flomps gloober Bat
    3. gloober Zoo flomps gloober Bat
    4. gloober Zoo flomps gloober Crystal
    5. gloober Crystal flomps gloober X-Ray
    6. gloober Bat flomps gloober Lovely

    gloober Zoo is the only yellow gloober.  Write the turn and which gloobers are yellow.

    1. Yellow gloobers - Zoo.
    2. Yellow gloobers -* Zoo, Bat.
    3. Yellow gloobers - Zoo, Bat, Crystal.
    4. Yellow gloobers - Zoo, Bat, Crystal, X-Ray.
    5. Yellow gloobers - Zoo, Bat, Crystal, X-Ray, Lovely.
    6. Yellow gloobers - Zoo, Bat, Crystal, X-Ray, Lovely.
&lt;/code&gt;&lt;/pre&gt;
Other than thinking the spread of yellow is limited to one gloober at a time, this seems right.</text></comment>