I fancied you might be going to tell me I ought to be more attentive, and not _allow_ my thoughts to wander. 
I fancied you might be going to tell me I ought to be more attentive, and not allow my thoughts to wander. 