Hermione made the mistake asking him the story about his lost love early on in their deviant encounters. The truth had been difficult to hear. She wished she had kept her mouth shut. He wouldn't let her come near him for almost a year after his heart-wrenching confession.