The all-encompassing distance between Albus and Scorpius is what allowed him to get involved with Avery in the first place. He himself realised last night that his love is one-sided because Albus has never reached out to him - though the thought still hurts him, he allows it to, because even so, Avery has clearly failed to achieve his goal so far.