He had nothing to do with the theatre then; I did not understand what he did, but I think he was continually at a gambling house, though he was careful always about taking me to the theatre. 
I think he spent his own time at a gambling house. 