the band of bastards was out in the field every night , but as the skirmishes with the lessening society tended to happen only in the desolate parts of the city , it was hard to get close enough while retaining a distance from john and the brotherhood .