Then there was the fact that his own mother had admitted to not caring for Voldemort's way of life. She just made the decision to save them, and would do anything to protect her family - her soulbond. Voldemort gave her no choice, just as Draco had not been allowed to choose his path. Die or watch as the other half of your soul and your son were murdered in front of your eyes, their life ebbing away because you made one choice, and it was wrong.