I Have a red IPV 5 for $ 30 <| sep |> member when the country jumped on Kaepernick ? !? Those who make peaceful protests impossible make violent protests inevitable . <| sep |> always exactly as superintelligent or as superstupid as you need it to be for the scenario to work out . On this topic , is a comment which has always stuck in my mind . I ' ve had several conversations that went like thisVictim But surely a smart artificial intelligence will be able to tell right from wrong , if we humans can do that ? Me Forget about the word intelligence for a moment . Imagine a machine that looks at all actions in turn , and mechanically chooses the action that leads to producing the greatest number of paperclips , in whichever way possible . With enough computing power and enough knowledge about the outside world , the machine might find a way to convert the whole world into a paperclip factory . The machine will resist any attempts by humans to interfere , because the machine ' s goal function doesn ' t say anything about humans , only paperclips . Victim But such a machine would not be truly intelligent . Me Who cares about definitions of words ? Humanity can someday find a way to build such a machine , and then we ' re all screwed . Victim . okay , I see your point . Your machine is not intelligent , but it can be very dangerous because it ' s superefficient . Me under my breath Yeah . That ' s actually my definition of superintelligent , but you seem to have a concept of intelligence that ' s entangled with many accidental facts about humans , so let ' s not go there .