The president never paid attention to what people thought about what he was doing.
That would assume, of course, that the president did not feel any psychological stress from realizing he was behaving in what many people regard as an immoral way.