"Ah, that's just what they said of Mr. Palliser when they felt ashamed of his having such a man as his guest. 
"Ah, that's just what they said about Mr. Palliser when they felt ashamed of his having him as his guest. 