Granted, these memorials should not glorify, but they should be placed somewhere for historical purposes. 

The Confederate history of the South is not a proud one, but it should be remembered so that it's not repeated.

Case in point: The German government decided to eradicate historical monuments and icons (Berlin Wall) from the Nazi and Cold War era in Berlin 20 years ago. They regretted the decision because there are still so many who want to "see" the part of history they have only read about.