I don't think it is so much memorializing "guys", but recognizing "events" in our history that helped form us into what we are today. Taking down the statues won't change history but leaving them will serve as a way to remember, and learn from, our history.