Nidderdale was endeavouring to speak so that only Dolly should hear him, and probably nobody else did hear him; but Dolly would not lower his voice. 
Nidderdale was speaking quietly, but Dolly would not lower his voice.
