Aunt Macleod had taken her judgement from this period of his life when she had spoken of him as a man who never did anything. 
Aunt Macleod was thinking of this period of his life when she said he was a man who never did anything. 