The moment he passes his fifth birthday, Harry is done. He needs to leave before the Dursleys turn him any more bitter than they already have. He went through all of this once already. Going through it again does nothing but embitter him to the world.