Getting caught out with your E on cooldown, especially during the early game will get you killed. Besides, if you keep roaming, chances are that your ADC will fall massively behind and will get killed frequently, especially if you are in a low elo bracket.