Using muscle memory to access your files and folders is a brilliant way to work, usually much faster that when you use Finder and regular non-desktop folders.
With too many icons, folders or projects you're working on at the same time, desktop soon goes out of control.