Your Ultimate R cooldown should be quite low at this point but do your best to save some Infernum rounds for a major fight. Although you're good in the late game, it is not recommended that you over-attack as Aphelios is very squishy.