Ramsay had even sent a raiding party to burn their supplies and harass them during the night, similar to what he did to Stannis. But Ser Davos had already warned them about this particular tactic. The raiders were found by one of the wildling skinchangers before they could even attack and met their end swiftly at the hands of the Thenns.