<story><title>Should AI Be Open?</title><url>http://slatestarcodex.com/2015/12/17/should-ai-be-open/</url></story><parent_chain></parent_chain><comment><author>poppingtonic</author><text>&amp;#x27;If you were to come up with a sort of objective zoological IQ based on amount of evolutionary work required to reach a certain level, complexity of brain structures, etc, you might put nematodes at 1, cows at 90, chimps at 99, homo erectus at 99.9, and modern humans at 100. The difference between 99.9 and 100 is the difference between “frequently eaten by lions” and “has to pass anti-poaching laws to prevent all lions from being wiped out”.&amp;#x27;&lt;p&gt;[EDITED: the intended quote is below. the quote above is the next paragraph of OP, which is only slightly less relevant than the intended one]&lt;p&gt;&amp;#x27;Why should we expect this to happen? Multiple reasons. The first is that it happened before. It took evolution twenty million years to go from cows with sharp horns to hominids with sharp spears; it took only a few tens of thousands of years to go from hominids with sharp spears to moderns with nuclear weapons. Almost all of the practically interesting differences in intelligence occur within a tiny window that you could blink and miss.&amp;#x27;&lt;p&gt;Yudkowsky&amp;#x27;s position paper on this idea explains this in more detail: &lt;a href=&quot;http:&amp;#x2F;&amp;#x2F;intelligence.org&amp;#x2F;files&amp;#x2F;IEM.pdf&quot; rel=&quot;nofollow&quot;&gt;http:&amp;#x2F;&amp;#x2F;intelligence.org&amp;#x2F;files&amp;#x2F;IEM.pdf&lt;/a&gt;</text></comment>
<story><title>Should AI Be Open?</title><url>http://slatestarcodex.com/2015/12/17/should-ai-be-open/</url></story><parent_chain></parent_chain><comment><author>pfisch</author><text>It is probably going to be the worst decision of humanity to allow AI research to continue past its current point.&lt;p&gt;I&amp;#x27;m not even sure how we could stop it, but we should really be passing laws right now about algorithms that operate like a black box where a training algorithm is used to generate the output.  For some reason everyone just thinks we should rush forward into this not concerned about an AI that is super human.&lt;p&gt;Whether it is a good or bad actor doesn&amp;#x27;t even matter.  Giving up control to a non-human entity is the worst idea humanity has ever had.  We will end up in a zoo either way.</text></comment>