The crimes for which folks go to jail seldom have anything to do with voting or "constitutional" matters.  Perhaps applicable to some members of the current administration...but that's another issue.

The idea of incarceration is that it's firstly a PENALTY imposed by law for improper behavior.  By definition when you've served the prescribed time you've PAID the penalty.  Secondly, it's SUPPOSED to involve "rehabilitation."  How does that happen when continuously marginalize someone AFTER he's done his time?  It's not as if the cards aren't stacked against the ex-con already in terms of employment, etc.

Self-inflicted?  Probably in most cases.  So by all means let's do everything we can to PREVENT him from turning himself around!  NO forgiveness--EVER! 

But don't pretend the idea is rehabilitation if you're going to keep him at arm's length and/or relegate him to second-class citizen status for the rest of his life.  No point letting him out at all if that's your goal.