In reply to this, he made use of the figurative expression--which has something Eastern about it--that he had never seen the colour of my money. 
He replied that he had never seen the colour of my money. 