Looking at the words of the man whose statue was being defended by Unite The Right and then destroyed by counter-protesters, why do they want this man/words removed from the public eye? 

This IS Robert E. Lee's beliefs. What needs banishing and why? Because it was the Democrats who wanted to NOT abolish slavery?

 [Quotes] 
* "So far from engaging in a war to perpetuate slavery, I am rejoiced that Slavery is abolished. I believe it will be greatly for the interest of the South. So fully am I satisfied of this that I would have cheerfully lost all that I have lost by the war, and have suffered all that I have suffered to have this object attained"
* "I believe it to be the duty of everyone to unite in the restoration of the country and the reestablishment of peace and harmony"
* "A nation which does not remember what it was yesterday does not know where it is today"
* "So far from engaging in a war to perpetuate slavery,I am rejoiced that slavery is abolished"
~ Robert E. Lee 
 

-