The old fee for service, private medical clinic model is broken.  New doctors don't want to go more in debt buying a practice and having to figure out how to manage staff and all that goes with owning a small business, which is what a medical practice is.  We'd be better off hiring physicians on salary to work in family medicine primary care clinics.  There is a lot of wasted space in our hospitals - not in the emergency room, where it might be useful, but in atriums and the like, that could be used for non-emergency treatment. 
When someone comes to emergency, they generally know if it's because they have an actual life and limb medical emergency, or if they just don't have any other options to be seen by a physician because they have no family doctor and can't make it to a walk in clinic.
We can't blame the non-emergency patients for clogging up the system if they have no other options.