<story><title>AI</title><url>http://blog.samaltman.com/ai</url></story><parent_chain><item><author>edanm</author><text>If anyone is interested in AI, I highly recommend joining Less Wrong, a community started by AI researcher Eliezer Yudkowsky. He started the community to convince people to focus on the &amp;quot;friendly AI problem&amp;quot;. [1] I actually recommend that everyone read LW, but &lt;i&gt;especially&lt;/i&gt; if you&amp;#x27;re interested in AI.&lt;p&gt;[1] In a nutshell, the friendly AI problem is: assume we create an AI. It may rapidly become more intelligent than us, if we program it right. As soon as it becomes significanlty more intelligent, we will no longer be the most intelligent beings around, so the AI&amp;#x27;s goals will matter more than ours.&lt;p&gt;Therefore, we should really give it good goals that are compatible with what we want to happen. And since no one right now knows how to define &amp;quot;what humans want&amp;quot; good enough for writing it in &lt;i&gt;code&lt;/i&gt;, then we&amp;#x27;d better figure THAT out &lt;i&gt;before&lt;/i&gt; building AI.</text></item></parent_chain><comment><author>marcosdumay</author><text>&amp;gt; we&amp;#x27;d better figure THAT out before building AI.&lt;p&gt;Why don&amp;#x27;t we just give that task to the AI? It&amp;#x27;ll be smarter than us...&lt;p&gt;Maybe the problem is that people are too easy to understand: We want &amp;quot;Brave New World&amp;quot;, but we don&amp;#x27;t want to know about it, or that we want it.</text></comment>
<story><title>AI</title><url>http://blog.samaltman.com/ai</url></story><parent_chain><item><author>edanm</author><text>If anyone is interested in AI, I highly recommend joining Less Wrong, a community started by AI researcher Eliezer Yudkowsky. He started the community to convince people to focus on the &amp;quot;friendly AI problem&amp;quot;. [1] I actually recommend that everyone read LW, but &lt;i&gt;especially&lt;/i&gt; if you&amp;#x27;re interested in AI.&lt;p&gt;[1] In a nutshell, the friendly AI problem is: assume we create an AI. It may rapidly become more intelligent than us, if we program it right. As soon as it becomes significanlty more intelligent, we will no longer be the most intelligent beings around, so the AI&amp;#x27;s goals will matter more than ours.&lt;p&gt;Therefore, we should really give it good goals that are compatible with what we want to happen. And since no one right now knows how to define &amp;quot;what humans want&amp;quot; good enough for writing it in &lt;i&gt;code&lt;/i&gt;, then we&amp;#x27;d better figure THAT out &lt;i&gt;before&lt;/i&gt; building AI.</text></item></parent_chain><comment><author>Houshalter</author><text>Defining human values completely and absolutely is an &lt;i&gt;extremely&lt;/i&gt; difficult problem that might not even have a solution. AI on the other hand is probably inevitable sometime within the next century.</text></comment>