half the men at castle black visited mole 's town from time to time to dig for buried treasures in the brothel , jon knew , but he would not dishonor ygritte by equating her with the mole 's town whores .