Harry remembered when Ginny had left, he couldn’t have gone to Ron, not that Ron was around anyway - at the time he was playing Quidditch in Germany. Hermione was always busy and they just weren’t as close as they had been.