The only trade off is that using Stealth Mode is slow and steady and thus requires patience.
Enemies are sometimes unpredictable and can turn around abruptly, but if you're using the cover function to hide behind objects you should be fine.