Add that to the fact that the galaxy as a whole pretty much proclaims him to be a monster, and you get a terrible self-loathing complex hidden beneath the surface.
When he first held that little baby girl and realized just who's hands she was resting in, fear gripped him and he ran....he just ran.