Perhaps his first collection of stories, "Twice-Told Tales", was printed in scarlet letters?
The 
Scarlet Letter, his 1850 novel about adultery, hypocrisy, and ... the stories in 
Twice-Told Tales, The Scarlet Letter is also touched