He had a fair point. Besides, his father was the most important person in Oliver's entire life. If he was able to forgive his mother for almost killing his father, surely there was some hope that he wouldn't hate them eternally.