He had no idea how to raise kids. His parents really weren't the best role models and Hermione's parents still didn't remember her, and never would. Potter's parents were dead, and all of his friends had shitty childhoods as well. 