Truthfully, those were men that just followed orders, as they couldn't disobey their liege lord without losing their lives. But, they had also butchered the men and women in Winterfell, and northern soldiers unprovoked and with deception. He could not release them, he did not trust them enough to use them, nor did he want all of them on the Wall where they could create trouble.