It’s just, sometimes, he didn’t know what to do. On one hand he desperately wanted to see Hermione, wanted to hear her voice. On the other hand, he knew he did her a favor by leaving. She was his sanctuary and he wasn’t going to destroy her by loving her. Potter was right. She did deserve better.