Could you imagine if we said, poor people can't join the military because they are much more likely to suffer from depression and substance abuse. There'd be outrage, but I'd be able to make the same exact argument as you.