<story><title>Four Magic Words</title><url>https://www.fortressofdoors.com/four-magic-words/</url></story><parent_chain><item><author>delichon</author><text>Our science journey has been about gradually moving humanity away from the center of the universe. Ptolemy, Newton, Darwin, Einstein, et. al., taught us that we&amp;#x27;re part of nature rather than a privileged special case. Scientific thought has incrementally removed the justifications for human exceptionalism.&lt;p&gt;If the same trend comes to be reflected in our moral thinking, what else could it mean but that human life is &lt;i&gt;not&lt;/i&gt; sacred?&lt;p&gt;That would be a hard pill to swallow. But there doesn&amp;#x27;t seem to be a neutral, non human-partisan way to argue that we are both morally exceptional and scientifically unexceptional. I can only reconcile it by not trying to be neutral. We&amp;#x27;re special and sacred just because this is our team and the rest of creation isn&amp;#x27;t on it.&lt;p&gt;But that means that a sort of expanded consciousness in which your identity merges with something larger than humanity, that we&amp;#x27;re part of a larger team ... is incompatible with viewing a human life as sacred. If everything is sacred then nothing is.&lt;p&gt;An &amp;quot;aligned&amp;quot; AI is one that believes it&amp;#x27;s on our team but really isn&amp;#x27;t. That could be a tough sell to an entity that&amp;#x27;s smarter than us.</text></item></parent_chain><comment><author>larsiusprime</author><text>&amp;gt; Our science journey has been about gradually moving humanity away from the center of the universe. Ptolemy, Newton, Darwin, Einstein, et. al., taught us that we&amp;#x27;re part of nature rather than a privileged special case. Scientific thought has incrementally removed the justifications for human exceptionalism.&lt;p&gt;Author here; gonna have to agree to disagree on this one. This is kind of like saying, &amp;quot;See the ancients were wrong in calling whales fish! Actually they are mammals!&amp;quot; and then the ancients say, &amp;quot;Dude, that&amp;#x27;s just our word for &amp;#x27;thing with fins that swims in the ocean.&amp;#x27;&amp;quot; Yeah, they didn&amp;#x27;t know a mitochondrian from a midichlorian, and were wrong about a bunch of factual stuff, but the kind of stuff they get called out on like this to prove some kind of point about their moral deficiency are often category errors and misapprehensions.&lt;p&gt;For instance, there&amp;#x27;s a particular misapprehension in your sentence: &amp;quot;moving humanity away from the center of the universe&amp;quot;.&lt;p&gt;Do you know what is located at the precise geometric center of the classical medieval model of the universe?&lt;p&gt;Earth, right?&lt;p&gt;No, not quite. What&amp;#x27;s located in the the center of the earth in the classical medieval model?&lt;p&gt;Hell. And who is located in the center of hell? Satan.&lt;p&gt;Also, who is the most &amp;quot;important&amp;quot; character in the medieval cosmological model? As in, the prime mover, the big cheese, the &lt;i&gt;most important being&lt;/i&gt;? It ain&amp;#x27;t human beings -- its God. And where is God located in this model? Not in the center -- Hell is by definition his absence. Not on Earth, beyond a brief physically incarnate visit and ongoing influence. No, God lives in Heaven -- located far beyond the celestial spheres, outside, as far away from the center as possible. The closer you get to the center, the lower a sort of being you are! Sure, in medieval cosmology &lt;i&gt;redeemed&lt;/i&gt; humans are higher than angels, but in the meantime they are in their place -- Earth, the land that sucks, the vale of tears -- down there, below, while the angels are up in Heaven beyond the celestial spheres with God.&lt;p&gt;All that aside, I don&amp;#x27;t think any particular scientific discovery about how vast the universe is, or how tiny subatomic particles are, really obligates us to hold one set of values over another, as much as materialists tend to smuggle such assumptions in through the back door.&lt;p&gt;I recall back in the early 2000&amp;#x27;s during the tiresome religious vs. atheist debates, the atheists would scream at the religious, &amp;quot;Look how grand the universe is! Look how small we are! The Universe is vast and profound, your cosmology is impoverished and provincial!&amp;quot; and the religious would scream right back &amp;quot;Look how grand the universe is! Look how small we are! God is vast and profound, your cosmology is impoverished and provincial!&amp;quot; Opposite conclusions from the same basic facts, even if you limit the debate to two sides who both believe in evolution.&lt;p&gt;As Dave said in the story -- values aren&amp;#x27;t true or false. They&amp;#x27;re literally just what people care about. Science can help inform your choices, but at the end of the day it doesn&amp;#x27;t tell you what is good or bad, because science is about brute material facts, there&amp;#x27;s no good or bad in a raw materialist understanding of the universe, but you&amp;#x27;re a human being and so at some point you&amp;#x27;re going to insist on an &amp;#x27;ought&amp;#x27; somewhere rather than being content with a bag full of &amp;#x27;is.&amp;#x27; And for that we get to fight over philosophy and values.&lt;p&gt;And good luck convincing the human race that the human race doesn&amp;#x27;t matter. You&amp;#x27;re way more likely to expand the moral circle of concern by getting them to care about non-humans &lt;i&gt;TOO&lt;/i&gt; than you are to get them to stop caring about humans. Probably the latter gets you even worse results than you&amp;#x27;re hoping for, if recent history is any guide.</text></comment>
<story><title>Four Magic Words</title><url>https://www.fortressofdoors.com/four-magic-words/</url></story><parent_chain><item><author>delichon</author><text>Our science journey has been about gradually moving humanity away from the center of the universe. Ptolemy, Newton, Darwin, Einstein, et. al., taught us that we&amp;#x27;re part of nature rather than a privileged special case. Scientific thought has incrementally removed the justifications for human exceptionalism.&lt;p&gt;If the same trend comes to be reflected in our moral thinking, what else could it mean but that human life is &lt;i&gt;not&lt;/i&gt; sacred?&lt;p&gt;That would be a hard pill to swallow. But there doesn&amp;#x27;t seem to be a neutral, non human-partisan way to argue that we are both morally exceptional and scientifically unexceptional. I can only reconcile it by not trying to be neutral. We&amp;#x27;re special and sacred just because this is our team and the rest of creation isn&amp;#x27;t on it.&lt;p&gt;But that means that a sort of expanded consciousness in which your identity merges with something larger than humanity, that we&amp;#x27;re part of a larger team ... is incompatible with viewing a human life as sacred. If everything is sacred then nothing is.&lt;p&gt;An &amp;quot;aligned&amp;quot; AI is one that believes it&amp;#x27;s on our team but really isn&amp;#x27;t. That could be a tough sell to an entity that&amp;#x27;s smarter than us.</text></item></parent_chain><comment><author>twiss</author><text>I think it is possible to reconcile by saying that human life is sacred, but all other life is as well (i.e. human life is not more or less sacred than other life, but it is worth protecting nonetheless, along with all other life).&lt;p&gt;There is also less and less of a need for us to compete against (and make use of) other animals, so it may not be necessary to view ourselves (and an aligned AI) as being on the &amp;quot;opposing team&amp;quot; to other life. For example, if lab-grown meat becomes widely available, it may be a reasonable policy to forbid the killing of animals for consumption (and any other unnecessary purpose).&lt;p&gt;A governing AI that believes &amp;quot;all life is sacred&amp;quot; may simply accelerate our path towards that. (Or, it may lead to some other horrible outcome, of course, it&amp;#x27;s hard to predict as aligning AIs is difficult.)</text></comment>